-- Logs begin at Thu 2022-08-18 15:53:56 UTC, end at Thu 2022-08-18 16:54:24 UTC. -- Aug 18 16:26:21.899308 dv-cinder-853679-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 16:26:21.906665 dv-cinder-853679-1-smb devstack@keystone.service[81620]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 16:26:21 2022] *** Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: nodename: dv-cinder-853679-1-smb Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: machine: x86_64 Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: clock source: unix Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: pcre jit disabled Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: detected number of CPU cores: 4 Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: current working directory: / Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: detected binary path: /usr/bin/uwsgi-core Aug 18 16:26:21.910117 dv-cinder-853679-1-smb devstack@keystone.service[81620]: your processes number limit is 47680 Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: your memory page size is 4096 bytes Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: detected max file descriptor number: 2048 Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: lock engine: pthread robust mutexes Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: thunder lock: enabled Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 16:26:21.910713 dv-cinder-853679-1-smb devstack@keystone.service[81620]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 16:26:21.949745 dv-cinder-853679-1-smb devstack@keystone.service[81620]: Python main interpreter initialized at 0x5643679e49c0 Aug 18 16:26:21.949745 dv-cinder-853679-1-smb devstack@keystone.service[81620]: python threads support enabled Aug 18 16:26:21.949745 dv-cinder-853679-1-smb devstack@keystone.service[81620]: your server socket listen backlog is limited to 100 connections Aug 18 16:26:21.949745 dv-cinder-853679-1-smb devstack@keystone.service[81620]: your mercy for graceful operations on workers is 90 seconds Aug 18 16:26:21.950110 dv-cinder-853679-1-smb devstack@keystone.service[81620]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 16:26:21.950190 dv-cinder-853679-1-smb devstack@keystone.service[81620]: *** Operational MODE: preforking *** Aug 18 16:26:21.950431 dv-cinder-853679-1-smb devstack@keystone.service[81620]: *** uWSGI is running in multiple interpreter mode *** Aug 18 16:26:21.950431 dv-cinder-853679-1-smb devstack@keystone.service[81620]: spawned uWSGI master process (pid: 81620) Aug 18 16:26:21.950633 dv-cinder-853679-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 18 16:26:21.951808 dv-cinder-853679-1-smb devstack@keystone.service[81620]: spawned uWSGI worker 1 (pid: 81631, cores: 1) Aug 18 16:26:21.951808 dv-cinder-853679-1-smb devstack@keystone.service[81620]: spawned uWSGI worker 2 (pid: 81632, cores: 1) Aug 18 16:26:21.951808 dv-cinder-853679-1-smb devstack@keystone.service[81620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 16:26:26.183154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:26:26.183154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: from cryptography.utils import int_from_bytes Aug 18 16:26:26.183914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:26:26.183914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: from cryptography.utils import int_from_bytes Aug 18 16:26:26.184491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:26:26.184491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 18 16:26:26.184958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:26:26.184958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 18 16:26:26.232844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:26:26.233033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:26:26.233222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] command line args: [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:26:26.233486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:26:26.233663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ================================================================================ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:26:26.233915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] admin_token = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.234125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:26:26.234217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_dir = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.234321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:26:26.234409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.234489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] config_source = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.234561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] command line args: [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:26:26.234664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] debug = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.234750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:26:26.234861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ================================================================================ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:26:26.236189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_dir = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_source = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] debug = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.236938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_config_append = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_dir = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_config_append = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_dir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.237993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.238541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.238624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.238795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.238879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.238939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.239912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.240824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] publish_errors = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.241984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] publish_errors = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] standard_threads = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.242872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_journal = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_json = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_stderr = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.243917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] use_syslog = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] standard_threads = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.244705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.244920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.245046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_journal = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.245163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.245277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_json = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.245277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_stderr = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.245497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.245612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_syslog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.245735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.245857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:26:26.245978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.246913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.247967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.248832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.249909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.250928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.251921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.252897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.253763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.254433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.254554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.254676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.254792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.254914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255505 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.255976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.256926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.257976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.258984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.259820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.260953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.261906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.262964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263069 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.263903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.264997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.265937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.266895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.267979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.268942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.269912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.270967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.external = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.password = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.271907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] auth.token = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272716 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.external = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.272951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.password = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.273912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.token = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.274900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.275973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.276946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.277986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.278948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.279912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.280886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.281968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.282999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.283952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.284853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.285469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.285590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.285707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.285832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.285951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.286915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.287961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.288806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.289971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.290900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.291971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.292946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.293904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.294963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.295905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.296890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.297948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.298897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.299900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.300016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.300197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.300315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.300445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.300564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.301930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.302926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.303907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.304996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.305926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.306949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.307998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.308966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.309906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.310981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.311912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.312925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.313880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.314947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.315899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.316981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.317934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.318913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.319981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.320967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.321913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.322507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.323451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:26:26.323451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:26:26.346008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.346235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.346460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.348180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.348412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.348637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.355825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.357049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.384171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.384400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.385523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.385757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.437660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.438475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.485749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.485974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.487229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.487467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.642944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643282 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.643719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.667268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.667495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.667678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.667764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.667917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.668805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.669020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.679626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.679911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.692461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.692641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.692856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.692953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.693918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.694137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:26:26.710769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.710977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:26:26.711232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.711317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.711443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:26:26.711527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:26:26.711763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.711845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.711967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:26:26.712049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.712269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.712534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.712616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.712791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.713048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.713313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.722106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.722384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.723203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.723292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.723485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.723569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.723798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.724109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.730473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.731262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.733379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.733665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.733945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.734192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.734275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.734483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.734579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.734746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.734828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.735952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.736142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.736251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.736538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.736821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.737097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.758946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.760050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.760417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.760700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.761539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.761825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.765370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.765654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.765939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.766536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.766823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.767111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.772818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.773103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.774049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.774337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.777183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.777470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.777751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.778033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.778310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.778474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.778583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.778769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.778851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.779056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.779145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.779342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.779622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.779904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.780212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.780483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.796949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.797227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.798266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.798548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.801124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.802498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.804348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.804643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.805742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.806046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.808854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.810297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.811960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.813459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.815198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.815496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.815781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.816083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.816394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.816675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.816769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.817062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.817350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.817639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.817932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.818233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.832887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.833186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.833452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.833713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.834683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.834972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.835247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.835515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.840582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.842091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.842374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.842457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.843980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.844281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.845023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.845306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.845585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.845881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.846158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.846922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.847215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.848037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.848367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.848648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.858241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.858541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.858809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.859089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.859370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.859646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.859922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.860014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.860269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.860555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.860840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.861126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.861404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.861681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.875518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.877457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.878572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.880572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.881634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.883068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.883483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.884560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.884844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.884960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.885140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.886436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.886732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.887029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.891592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.893060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.893583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.895564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.896502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.896800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.897086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.897365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.898534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.898834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.899123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.899411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.905274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.905559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.905840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.907425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.907722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.908016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.913334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.913618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.913901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.914179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.914451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.914731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.915004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.915271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.915491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:26:26.915584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.915778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.915861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.916969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.917168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.917437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.917723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.918001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.918286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.918559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.918835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.919095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:26:26.950616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643679e49c0 pid: 81631 (default app) Aug 18 16:26:26.953487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643679e49c0 pid: 81632 (default app) Aug 18 16:26:26.953934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fda1-be90-4db3-a55c-44d304405d69 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:26.954217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fda1-be90-4db3-a55c-44d304405d69 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:26.954487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74fda1-be90-4db3-a55c-44d304405d69 None None] PATH_INFO: `/v3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:26.959144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Thu Aug 18 16:26:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:33.446674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:33.447229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:33.447229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:33.451519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:33.456596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:33.456990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:33.457129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:33.526028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: INFO dbcounter [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] Registered counter for database keystone Aug 18 16:26:33.544433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG oslo_db.sqlalchemy.engines [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:26:33.550988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writer thread running {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:26:33.728164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG passlib.handlers.bcrypt [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81631) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 16:26:33.728525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG passlib.handlers.bcrypt [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81631) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 16:26:33.783270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:33.785397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:33.908775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 16:26:34.365931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:34.433669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: INFO dbcounter [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] Registered counter for database keystone Aug 18 16:26:34.454682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG oslo_db.sqlalchemy.engines [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:26:34.461344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writer thread running {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:26:34.578718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c9477-fcd0-4c0c-8dee-dab080a7d1e0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:34.583523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:34.584168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:34.584447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:34.584712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:34.592722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:34.644933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING keystone.common.rbac_enforcer.enforcer [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 16:26:34.645270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c946b-e08d-4ea0-9ca8-751b304a5356 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:34.654740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Thu Aug 18 16:26:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:26:34.660707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:34.674902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795009d8-09d2-4cfd-a58e-86133a6f63b9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:34.679305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:34.680419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:34.680700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:34.680972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] PATH_INFO: `/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:34.682546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f85ef77f8be4f4d9ae6c447129ea73f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:34.735368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 16:26:34.735719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e996049-e6cb-40d8-bafd-6f10357f5eb1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:34.740334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Thu Aug 18 16:26:34 2022] GET /identity/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:36.605439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092561be-197a-4cbb-9169-230b7bace2d3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:36.605979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092561be-197a-4cbb-9169-230b7bace2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:36.605979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092561be-197a-4cbb-9169-230b7bace2d3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:36.610100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:36.615536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:36.615947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:36.616111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:36.635698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:36.637225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:36.645552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 16:26:36.912811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092561be-197a-4cbb-9169-230b7bace2d3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:36.924810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092561be-197a-4cbb-9169-230b7bace2d3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:36.929054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:36.929649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:36.929930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:36.930204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:36.937675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:36.939434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c094e78-7567-4b73-bcb5-21b94e10d520 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:36.948510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Thu Aug 18 16:26:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:26:36.953573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:36.962940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582af2a-6ead-495a-92f3-278ef7d2a681 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:36.967189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:36.967802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:36.968107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:36.968386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:36.969670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:36.971466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd67bfb-fb98-46c8-ac05-40db3c41a92c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:36.973015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Thu Aug 18 16:26:36 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:38.910440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067baf-77c3-41ee-9003-af3d65853e20 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:38.911015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067baf-77c3-41ee-9003-af3d65853e20 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:38.911015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08067baf-77c3-41ee-9003-af3d65853e20 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:38.912329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:38.917345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:38.917782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:38.917875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:38.935567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:38.936767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:38.970635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b83a8-8897-4bea-9e2f-db51bb6ff9fb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:38.970921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b83a8-8897-4bea-9e2f-db51bb6ff9fb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:38.971197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b83a8-8897-4bea-9e2f-db51bb6ff9fb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:38.973100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:38.978018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:38.978300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:38.978573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.014741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:39.020454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81632) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 16:26:39.020874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81632) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 16:26:39.066826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:39.068409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:39.165878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:39.278670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.303481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.383928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493a21c-0a41-4cc0-afa2-e58a0ac0ece9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.416576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.417207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.417487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.417764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.429315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:39.438051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:39.439167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:26:39.440235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:26:39.446924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.447158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.526584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.544628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cea24-4f45-4dc4-a327-91e2e3aea041 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.547041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91121d3f-7dad-4e7f-9ad2-d4ceeed4e257 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.549761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.579747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.580400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.580679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.580949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.581601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:39.581898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:39.583276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:39.585029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.585878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.586163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.586654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.594632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:39.600329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.653774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:39.655287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:39.697715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034f809-e731-4aef-9b99-e2fabf8f9f3d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.733483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.734106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.734388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.734656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.735778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:39.737266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:39.739318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 9/16] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:39.744845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.752041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 8/17] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:39.758066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.759618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.761042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.843465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08aa24-6217-4a21-925d-777043400ed9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.854875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be284d-bdd0-461f-a3d1-1469fed010d4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.877470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.878089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.878368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.878637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.879732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:39.881200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:39.882717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 10/18] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:39.888339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.892221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:39.893066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:39.893348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:39.893621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:39.912330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:39.913817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:26:39.931912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:39.932834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:26:39.933667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:26:39.933667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:26:39.933667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:39.933667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 9/19] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:26:39.938667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:39.967755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:39.987634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87671c-f3c0-4b02-98b3-e5b18f6a02f8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:39.993038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:40.021485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:40.022093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:40.022376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:40.022655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:40.023377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.domain.id=default, user.id=055098f463f14b67a24ad1d104cbba34) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:40.023685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:40.025182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b14d-b8ac-4fe9-9f58-3e13b6542976 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:40.031718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/role_assignments?user.id=055098f463f14b67a24ad1d104cbba34&scope.domain.id=default&role.id=f6300a9e15d04a299f9847938352da84 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:40.035984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd9d70-244c-4bb8-a210-3db289a3416f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:40.071987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:40.072639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:40.072919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:40.073191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:40.073854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:40.074159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:40.075592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be2e4c-a718-40d5-b6b8-6792e9b1d2e9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:40.096233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:42.070414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935a7c-9a15-4cdf-88bf-08d21a5e0199 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.070907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935a7c-9a15-4cdf-88bf-08d21a5e0199 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.070907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935a7c-9a15-4cdf-88bf-08d21a5e0199 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.072433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:42.077487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.078286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.078794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.102341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:42.103866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:42.175800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e856-cc45-4cee-9fcd-5cbf9eb42ff0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.176135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e856-cc45-4cee-9fcd-5cbf9eb42ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.176373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e856-cc45-4cee-9fcd-5cbf9eb42ff0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.177937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 13/23] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:42.187697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.187986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.188281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.198654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:42.225163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:42.226352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:42.324134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:42.525472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:42.583722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:42.653223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929822f6-4a4d-4a50-8c0e-7dfd354b566c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:42.696936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:42.697581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.697862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.698133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.713771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bf6fc34e-0d0c-4442-9bdf-d443b779271c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:42.720235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:42.721109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:42.722001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 12/26] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:42.731310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:42.818314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164e9b8-f988-4dc2-88ab-da37911da21e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.818592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164e9b8-f988-4dc2-88ab-da37911da21e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.819022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164e9b8-f988-4dc2-88ab-da37911da21e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.820543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:42.823650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164e9b8-f988-4dc2-88ab-da37911da21e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:42.852490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:42.880376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e45c3-461e-441e-8a90-55529527412f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:42.918868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:42.919705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.920210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.920618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.921533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:42.922018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:42.923583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06caf50-7e38-4e3b-9684-1ece698c6888 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:42.933126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 15/28] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:42.934435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6e1a-80ba-40df-864d-6be9fcdce8bc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:42.934874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6e1a-80ba-40df-864d-6be9fcdce8bc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:42.935382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6e1a-80ba-40df-864d-6be9fcdce8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:42.954330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-484a6e1a-80ba-40df-864d-6be9fcdce8bc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:42.955772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-484a6e1a-80ba-40df-864d-6be9fcdce8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:42.958263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164e9b8-f988-4dc2-88ab-da37911da21e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:42.967626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:43.006146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.007051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.007467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.008341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.021522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.023620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.039136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 16/29] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:43.040670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218d77-877b-4c2d-898a-248a45ea2be0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.041015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218d77-877b-4c2d-898a-248a45ea2be0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.041299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218d77-877b-4c2d-898a-248a45ea2be0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-684cca2b-e932-448f-92ad-4cd462706b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:26:43.042348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:43.043258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:26:43.044375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:26:43.044375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:26:43.044375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:43.044587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 17/30] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:43.045844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 14/31] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:43.046716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218d77-877b-4c2d-898a-248a45ea2be0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.049297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.049811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.051257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.074946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:43.076714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:43.133235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:43.175285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 15/32] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:43.176830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.201773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218d77-877b-4c2d-898a-248a45ea2be0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:43.312835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.313778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.313778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.314043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.315250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.317324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.318920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 18/33] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:43 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:43.323351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:43.329039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.345189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e905cb-d295-4e69-b879-87baaa3dbc13 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:43.410150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.410772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.411054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.411330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.411978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:43.412313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.413711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.435447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 16/34] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:43.436050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.512267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d9abb-d149-415b-8440-a8011c797a6c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:43.569504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.570139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.570422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.570698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.572097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.573742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.575763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 19/35] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:43.580690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.584234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:43.603616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1919e-050e-4e5b-b25c-36ac13d086f6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:43.649330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.650802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.651533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.652014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.653139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.655375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.699139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff272-e204-455e-ab7e-9f336e92adae None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:43.754200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:43.755135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:43.755633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:43.756192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:43.757069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:43.758785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:43.812543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 17/36] 10.222.0.73 () {60 vars in 1131 bytes} [Thu Aug 18 16:26:43 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:43.813718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.836493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:43.917683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 20/37] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:26:43 2022] POST /identity/v3/projects => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:43.925905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:43.953386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba4ac-b426-4b8a-bf2e-234044899e99 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:44.006253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:44.006904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.007192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.007472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.008198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:44.009856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bb7cd-beec-444e-8c0f-4af2add0eedf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:44.033254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:44.033441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 18/38] 10.222.0.73 () {60 vars in 1131 bytes} [Thu Aug 18 16:26:43 2022] POST /identity/v3/roles => generated 219 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:44.033819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dbc3-72c6-4e01-9f37-008ba0b10874 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.034014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dbc3-72c6-4e01-9f37-008ba0b10874 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.034465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dbc3-72c6-4e01-9f37-008ba0b10874 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.036110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 19/39] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:44.043640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d32aa-a88f-41a4-ab5c-0cc157931de2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.044018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d32aa-a88f-41a4-ab5c-0cc157931de2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.044534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d32aa-a88f-41a4-ab5c-0cc157931de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.071363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-341d32aa-a88f-41a4-ab5c-0cc157931de2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:44.073944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-341d32aa-a88f-41a4-ab5c-0cc157931de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:44.156520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72001-943e-4416-8631-dc5c281302a1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:44.178549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:44.187100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 20/40] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:44.198387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c817e-bf31-4d62-b863-e64ebce5bf29 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.198705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c817e-bf31-4d62-b863-e64ebce5bf29 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.198971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c817e-bf31-4d62-b863-e64ebce5bf29 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.200545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 21/41] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:44.207995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.208334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.208549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.212781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:44.213475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.213807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.214092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] PATH_INFO: `/v3/domains/default/users/055098f463f14b67a24ad1d104cbba34/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.216369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=055098f463f14b67a24ad1d104cbba34, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:44.218387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:44.236172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:44.237332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 21/42] 10.222.0.73 () {58 vars in 1361 bytes} [Thu Aug 18 16:26:43 2022] PUT /identity/v3/domains/default/users/055098f463f14b67a24ad1d104cbba34/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:26:44.237961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:44.336891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 22/43] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:44.470249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:44.607428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:44.684710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07073122-5694-4e13-88db-7f6f8f9d7aec None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:44.701079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:44.727823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61717a-7cdd-441c-9556-824375b1bce5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:44.731375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:44.732798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.733278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.733745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.734623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:44.736373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:44.753933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1131 bytes} [Thu Aug 18 16:26:44 2022] POST /identity/v3/roles => generated 223 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:44.754506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:44.764785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:44.765783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.766237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.766690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.768406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:44.770647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d174b-11fc-463f-9791-aa17423a2037 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:44.772602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 23/45] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:44.778520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:44.890311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49eba-02b9-4aad-aa6e-e13ae0a875ad None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:44.927622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:44.928269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:44.928559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:44.928836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:44.929476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:44.930941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c515b6-918d-42dd-9622-e4ff835fc0a4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:44.963802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 23/46] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:26:44 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:46.147244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60252-0b50-4e52-9dc1-91f290ea0e24 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.147752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60252-0b50-4e52-9dc1-91f290ea0e24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.147836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60252-0b50-4e52-9dc1-91f290ea0e24 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.149168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 24/47] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:46.154292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.154690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.154853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.173292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:46.174793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:46.194215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:46.239984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 24/48] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:46.505200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60252-0b50-4e52-9dc1-91f290ea0e24 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:46.605231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60252-0b50-4e52-9dc1-91f290ea0e24 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:46.638610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:46.639242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.639528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.639804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.650626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:46.655383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:46.656334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:46.657419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 25/49] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:46.663333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:46.762093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fa410-29af-4c95-a995-240b9377f3a9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:46.795027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:46.795639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.795926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.796238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.796903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:46.797211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:46.798604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98ead3-35cb-4518-bfed-73b65b38c07a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:46.806663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 25/50] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:46.812203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:46.829857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cf363-0ded-4431-801b-f9827548c2e1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.830145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cf363-0ded-4431-801b-f9827548c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.830423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cf363-0ded-4431-801b-f9827548c2e1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.832433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 26/51] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:26:46.837085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.837376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.837660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.854886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:46.856106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:46.867486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:46.869359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:46.911252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d65ab-c708-43c5-b9e4-14ff329f8e8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:46.923336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 27/52] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:46.944546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:46.945204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:46.945488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:46.945763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:46.947137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:46.948632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:46.950306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:46 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:46.955573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:47.049415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5c113-0564-4b2d-b660-d6c7a011e985 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:47.082263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:47.082889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:47.083169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:47.083445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:47.084587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:47.086028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:47.087578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 28/54] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:47.093356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:47.191787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:47.192305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641c609-f933-4ab9-a859-7aad740ca786 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:47.209896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:47.214538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:47.225397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:47.226006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:47.226289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:47.226566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:47.227286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.domain.id=default, user.id=055098f463f14b67a24ad1d104cbba34) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:47.227591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:47.229059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:47.238374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1322 bytes} [Thu Aug 18 16:26:47 2022] GET /identity/v3/role_assignments?user.id=055098f463f14b67a24ad1d104cbba34&scope.domain.id=default&role.id=f6300a9e15d04a299f9847938352da84 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:47.296727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba6f-2952-4bac-b191-9700b015bfcd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:47.331921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:47.332506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:47.332786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:47.333059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:47.334209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:47.335701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d9368-db15-491e-a495-14af5650e951 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:47.337336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 29/56] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:26:47.343189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:47.447173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860492a4-da8f-4a48-af8f-66ed5dbbb8d7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:47.582984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:47.583520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:47.583784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:47.584083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:47.584709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:47.586129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb4a2-727d-4873-9771-391bcb010ffc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:47.613922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 28/57] 10.222.0.73 () {60 vars in 1140 bytes} [Thu Aug 18 16:26:47 2022] POST /identity/v3/projects => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:49.492955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef15bf-cd71-4116-8d5d-1c178ced05a2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:49.493468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef15bf-cd71-4116-8d5d-1c178ced05a2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:49.493570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef15bf-cd71-4116-8d5d-1c178ced05a2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:49.494845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 30/58] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:49.500156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:49.500521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:49.500714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:49.518974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:49.520221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:49.553201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:49.585978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 29/59] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:49.852044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef15bf-cd71-4116-8d5d-1c178ced05a2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:49.934693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:49.951452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef15bf-cd71-4116-8d5d-1c178ced05a2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:49.983231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:49.983853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:49.984162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:49.984439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:49.985545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:49.986996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32b696-293e-4d3b-b768-3da01b80769c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:49.989101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 31/60] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:49.994490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:50.088832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5568f-d0e8-43c4-a805-f3b222db2c6e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:50.122335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:50.122869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:50.123153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:50.123422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:50.124350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:50.125772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361cf99-738c-4002-9801-ce9535550578 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:50.150683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 30/61] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:26:49 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:53.141523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955836a-7615-4d47-9416-68970bd8bc17 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.142448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a122d3-3696-4795-a7e3-5ff9cf014680 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.143210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a122d3-3696-4795-a7e3-5ff9cf014680 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.144250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955836a-7615-4d47-9416-68970bd8bc17 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.144748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a122d3-3696-4795-a7e3-5ff9cf014680 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.145218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955836a-7615-4d47-9416-68970bd8bc17 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.148725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 32/63] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:53.148947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:53.155465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e959-5202-4463-9821-becbb4c6b8d9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.155611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b819e8-e7fe-4763-9d3c-b625191bab99 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.155798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b819e8-e7fe-4763-9d3c-b625191bab99 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.156135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e959-5202-4463-9821-becbb4c6b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.156422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1e959-5202-4463-9821-becbb4c6b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.156765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b819e8-e7fe-4763-9d3c-b625191bab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.185085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0b819e8-e7fe-4763-9d3c-b625191bab99 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:53.186317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0b819e8-e7fe-4763-9d3c-b625191bab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:53.186899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-83a1e959-5202-4463-9821-becbb4c6b8d9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:53.188392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-83a1e959-5202-4463-9821-becbb4c6b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:53.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:53.307292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 32/64] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:53.317377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 33/65] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:53.359131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbef9d-d650-4ea0-895d-b82bdefb8202 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.359466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbef9d-d650-4ea0-895d-b82bdefb8202 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.359695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbef9d-d650-4ea0-895d-b82bdefb8202 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.361098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 33/66] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:53.369297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78792e-732a-47cf-b7a0-ba53077f0ab2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.369590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78792e-732a-47cf-b7a0-ba53077f0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.369873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78792e-732a-47cf-b7a0-ba53077f0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.401137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fd78792e-732a-47cf-b7a0-ba53077f0ab2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:53.402277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fd78792e-732a-47cf-b7a0-ba53077f0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:53.493879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 34/67] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:53.516435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f064c6-5c01-4b3b-8487-4a91d34cca98 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.517055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f064c6-5c01-4b3b-8487-4a91d34cca98 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.517534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f064c6-5c01-4b3b-8487-4a91d34cca98 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.519347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 34/68] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:53.524431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.524718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.524994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.547824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:53.549021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:53.561809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:53.630553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f064c6-5c01-4b3b-8487-4a91d34cca98 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:53.650824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 35/69] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:53.693944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:53.798075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f064c6-5c01-4b3b-8487-4a91d34cca98 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:53.845467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df4cc8-c755-4ddc-a7a9-7bc4b4c91b3b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:53.850370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:53.851297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.851724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.852216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.864247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:53.869612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:53.870655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:53.871619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:53.873449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 35/70] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:26:53.874628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:53.885355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:53.886197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:53.886630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:53.887071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:53.903323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:53.906337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:53.914656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:53.915718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:26:53.916703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:26:53.919504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 36/71] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:53.921189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:53.926207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:53.994697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdee08-5bdb-4c3e-8a24-67fd6fe9c67e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.028076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.028714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.028995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.029264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.033947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1c0b-02c8-465e-bb0d-5cc0585177a3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.039457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:54.044094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:54.044973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:54.045743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 36/72] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:54.046380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.070805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.071416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.071699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.071996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.072670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:54.072978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.074358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.082678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 37/73] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:26:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.083453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.122110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.142838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.145962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c043d-c58b-4e3e-a392-1657f6514cf6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.179034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.179639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.179731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14104-ad61-4729-9771-6f238afa8111 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.179926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.180234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.180895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:54.181213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.182605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e4d7-454e-4820-b5eb-aa8dd8fbcebe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.194602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 37/74] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.195770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8aa39-5c64-44f5-b8a2-e4f1929958a3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.196083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8aa39-5c64-44f5-b8a2-e4f1929958a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.196363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8aa39-5c64-44f5-b8a2-e4f1929958a3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.197572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 38/75] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:54.200179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8aa39-5c64-44f5-b8a2-e4f1929958a3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.217832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.218463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.218747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.219025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.229220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:54.235071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:54.236083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 38/76] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:54.241046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.298260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8aa39-5c64-44f5-b8a2-e4f1929958a3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.331373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72017-316c-404a-975f-a538dee97482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.331992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72017-316c-404a-975f-a538dee97482 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.332298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72017-316c-404a-975f-a538dee97482 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.332582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d72017-316c-404a-975f-a538dee97482 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.333238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72017-316c-404a-975f-a538dee97482 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:54.333545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72017-316c-404a-975f-a538dee97482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.334951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d72017-316c-404a-975f-a538dee97482 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.337969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be7ce5-4154-4f92-9189-3c19ecb1d517 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.339760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.343718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 39/77] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.344791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72017-316c-404a-975f-a538dee97482 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.364812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.375981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.376635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.376919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.377218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.390193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.391658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be91ed-3688-4258-a874-3e0a484df5b4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.393826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 39/78] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.398486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.398486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.398486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.412118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:54.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:54.449935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d72017-316c-404a-975f-a538dee97482 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.477863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 40/79] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:54.478680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.488603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.489232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.489511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.489781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.490907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.492387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.494091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 40/80] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.494688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.558109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.588454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507862-78f4-42fd-84d1-acde3972b398 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.593214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1add51-b663-43f1-aef2-b460b43004bb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.603401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.626040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.626649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.626928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.627199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.627482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.628454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:54.628690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.628795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.628967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.629234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.630116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.630368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.631797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.633404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 41/81] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.638531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.641480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 41/82] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:54.642134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.751883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352050f-0fec-4217-926c-1abcdda8aa3e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.764268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7817-58ea-424b-8277-b7276b739554 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:54.786454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.787063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.787344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.787615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.790937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.797802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:54.798413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:54.798698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:54.798974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:54.840725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:54.853513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.854995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.866995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:54.868520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:54.954935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 42/83] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:54.960348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.965081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 42/84] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:54.965906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:54.993804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.037895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.056849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550bcd5-adba-44f7-bfb7-5a3a787d9071 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.062135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0905f-d6f0-4d10-8f92-2738cdf7551c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.089294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.089904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.090187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.090460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.094250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.094811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.095091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.095360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.097020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.098498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.100131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 43/85] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.100882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.161719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.163192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.195454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.198910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450aa0a-49e3-48b4-bd50-6cf98714b360 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.231971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.232649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.232956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.233232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.234306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.235724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.237342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 44/86] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.238092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.250435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.262812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 43/87] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:55.264956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.337803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69efd-a916-4251-a6d4-89548a57988b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.361005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923f4d9-7304-473d-b8bc-b7552581dd30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.370285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.370905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.371185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.371462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.372593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.374297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.375896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 45/88] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.376673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.396226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.396860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.397141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.397412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.398532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.399979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.401608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 44/89] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.402341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.406564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.459360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.480465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc08cba-df45-4afd-aa82-e56ffee4ffdd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.498743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963e746-6c6c-4c74-8822-e703c776301a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.513999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.514629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.514910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.515183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.532768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.533368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.533647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.534450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.535100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.536582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.557276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 45/90] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:26:55 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:26:55.557276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.595120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.596990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.629983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.682127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbb37b-478c-4492-9a10-d5b0193c1c07 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.686897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.710829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 46/91] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:55.711693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.728956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.729615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.729898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.730173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] PATH_INFO: `/v3/projects/06be975c15624c959cf0632ea6c9d1f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.731351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] RBAC: Authorizing `identity:get_project(project_id=06be975c15624c959cf0632ea6c9d1f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.732844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.734650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 46/92] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/projects/06be975c15624c959cf0632ea6c9d1f9 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.735255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.843431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc2671-88b8-4c3d-bbb0-319c3faaa1cc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.857303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26283514-d7c2-41da-8e8d-cde0e831f8fc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:55.885184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.885725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.886009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.886345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.887070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:55.887694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.888161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:55.890046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.896086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 47/93] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=3524ec8100184d48956522845b1fbebe => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.896756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.898831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:55.899459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:55.899741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:55.900011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:55.900780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=055098f463f14b67a24ad1d104cbba34) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:55.901087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:55.902567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:55.914646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 47/94] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/role_assignments?user.id=055098f463f14b67a24ad1d104cbba34&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:55.914646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:55.962920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:56.036461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97370-0246-4e4b-9927-4d6cb6444019 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:56.054483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc218e6-f4c3-40a0-9022-0a95b09f1c22 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:56.081257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:56.082043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:56.082423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:56.082794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:56.083654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=06be975c15624c959cf0632ea6c9d1f9, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:56.084090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:56.086000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:56.092785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 48/95] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=06be975c15624c959cf0632ea6c9d1f9&role.id=3524ec8100184d48956522845b1fbebe => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:56.109938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:56.110595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:56.110875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:56.111148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:56.112992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:56.114641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520bca9-cb4b-45c8-8022-4aaba70455aa None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:56.116563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 48/96] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:26:55 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:56.122812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:56.204594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:56.259645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8b58-64c8-4dab-9a75-1ed3cdde35c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:56.308108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:56.308108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:56.308108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:56.308108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:56.308489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:56.308489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:56.308489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25572e-a4b3-4742-895c-a298571494f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:56.318261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 49/97] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:26:56 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:58.278818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd399e6-ec61-433d-bb0f-7af4b2648ab2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.279324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd399e6-ec61-433d-bb0f-7af4b2648ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.279421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd399e6-ec61-433d-bb0f-7af4b2648ab2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.280726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 49/98] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:58.286557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df001abb-c561-48e7-a452-f71b27c78e4f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.286947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df001abb-c561-48e7-a452-f71b27c78e4f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.287127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df001abb-c561-48e7-a452-f71b27c78e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.306418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df001abb-c561-48e7-a452-f71b27c78e4f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:58.307597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df001abb-c561-48e7-a452-f71b27c78e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:58.394445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 50/99] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:58.672072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd399e6-ec61-433d-bb0f-7af4b2648ab2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:58.686871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a53e9-01e4-437a-ad91-6940b27a9db8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.687464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a53e9-01e4-437a-ad91-6940b27a9db8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.687926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a53e9-01e4-437a-ad91-6940b27a9db8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.689487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 51/100] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:58.691487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0362-9ae7-4529-80be-a100e036b6d8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.691932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0362-9ae7-4529-80be-a100e036b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.692365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0362-9ae7-4529-80be-a100e036b6d8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.697993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 52/101] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:58.699262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd2d5-082b-4290-a4f6-cba094c5e9c1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.699735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd2d5-082b-4290-a4f6-cba094c5e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.700240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd2d5-082b-4290-a4f6-cba094c5e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.726677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0bcfd2d5-082b-4290-a4f6-cba094c5e9c1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:58.728225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0bcfd2d5-082b-4290-a4f6-cba094c5e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:58.824375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:58.859180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd399e6-ec61-433d-bb0f-7af4b2648ab2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:58.870346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 53/102] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:58.871325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:58.876082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b616894-97de-4276-ba5c-69f65b533256 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.876082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b616894-97de-4276-ba5c-69f65b533256 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.876082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b616894-97de-4276-ba5c-69f65b533256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.910207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9b616894-97de-4276-ba5c-69f65b533256 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:58.911426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b616894-97de-4276-ba5c-69f65b533256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:58.916081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:58.917078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:58.917601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:58.918093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:58.930047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:58.947379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:58.948384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:26:58.949165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 50/103] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:58.957005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.041764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 54/104] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:59.043369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a371a6-844e-4171-90a2-0efa502e6c3d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.043849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a371a6-844e-4171-90a2-0efa502e6c3d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.044371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a371a6-844e-4171-90a2-0efa502e6c3d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.045798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 55/105] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:59.075229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2ce5-8793-423e-8c9a-22716e5d366c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.075832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2ce5-8793-423e-8c9a-22716e5d366c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.076694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade2ce5-8793-423e-8c9a-22716e5d366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.109893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1ade2ce5-8793-423e-8c9a-22716e5d366c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:59.112991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1ade2ce5-8793-423e-8c9a-22716e5d366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:59.118490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aeff2-1330-4708-a1cb-0c53d8e996c8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.179438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.180493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.180983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.181444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.182292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:59.182786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:59.184410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:59.196860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 56/106] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:26:59.197832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 51/107] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:26:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:59.200857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8987e-69ae-4372-9373-e16c8b5d28a0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.200857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8987e-69ae-4372-9373-e16c8b5d28a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.200857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8987e-69ae-4372-9373-e16c8b5d28a0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.200857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 57/108] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:59.203982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.205842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.206318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.206823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.226601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:26:59.228269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:26:59.249854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.268309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.304158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 58/109] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:26:59.332497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bad0a-8767-4844-b4be-9e8ad3e16e21 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.368693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.369376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.369664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.369936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] PATH_INFO: `/v3/users/0aa4fe93a70b4770916eefac7a9f340f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.374823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.385740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] RBAC: Authorizing `identity:get_user(user_id=0aa4fe93a70b4770916eefac7a9f340f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:59.387030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:59.389004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 52/110] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/users/0aa4fe93a70b4770916eefac7a9f340f => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:59.394587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.517519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.524471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05dc2-985b-436c-bfe4-d63ad4ea31cd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.528824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97f65-d7a9-460a-8e2f-e4d90c88d01f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.567713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.568350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.568858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.569355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.585663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.586530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.586994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.587440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.598740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:59.603744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:59.604584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:59.605380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:59.607638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 59/111] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:26:59.608723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.639550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.648947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:59.650422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:59.713225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f845c-9826-4ef4-89fc-c87a334c07fa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.742906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.747729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.748403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.748686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.749220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.750337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:59.751797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:59.753608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 60/112] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:59.753711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 53/113] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:26:59.754160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.754411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.848360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:26:59.851813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98f4c2-b2a8-4225-be83-a2baffd6f207 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.852433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f71cd8-c33f-468f-9c48-e9767cbc41b9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:26:59.885320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.885481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:26:59.885928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.886044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.886210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.886296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.886480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.886573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.887165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:26:59.887472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:26:59.888881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279c320-a983-4323-87aa-498600dc9788 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:26:59.896981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:26:59.897256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 54/114] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:26:59.901670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:26:59.902499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:26:59.903282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 61/115] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:26:59.903912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97716f7-ec22-4fe9-bee1-47fc49669c34 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:26:59.903912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97716f7-ec22-4fe9-bee1-47fc49669c34 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:26:59.904028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.904623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97716f7-ec22-4fe9-bee1-47fc49669c34 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:26:59.904966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 55/116] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:26:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:26:59.905655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97716f7-ec22-4fe9-bee1-47fc49669c34 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:26:59.958533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.002117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9f39-35dc-49aa-b78f-415d07e99099 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.005747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97716f7-ec22-4fe9-bee1-47fc49669c34 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.039415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.040094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.040227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.040459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.040729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.040821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.041014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.041291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.041374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.042906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.052227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:00.056620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:00.057478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 62/117] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:00.063513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.080088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 56/118] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:26:59 2022] POST /identity/v3/projects => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:00.080088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.089430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.185156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a9d1-bbac-4eb5-aa43-fedf08b194d1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.192519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099ccd-dc24-4f63-a458-129f0eac1d9d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.194976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.225625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.226270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.226558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.227086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.228832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.230297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.232219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 63/119] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.232799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.237575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.238464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.238752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.239022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.240256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.241878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469914f7-7ace-4701-8345-e72f71641d8a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.243716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 57/120] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.244719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.245003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.245278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.265363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:00.266550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:00.321101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.344099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 58/121] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:00.344099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.347821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a54a0-0709-4d74-bac3-7242705aa83a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.388778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.389657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.389948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.390225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.391367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:00.391671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.394166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.405241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 64/122] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.406458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.453332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2e6ab-f691-48d9-b313-f91599fee4c0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.454995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.491837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.492594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.492944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.493331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.494116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:00.494564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.496153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.505807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 59/123] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.511277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.536719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916876-75ee-4120-9d08-3551504b1138 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.575989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.576634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.576917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.577190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.578422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=0aa4fe93a70b4770916eefac7a9f340f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:00.578739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.580479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.588838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 65/124] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/role_assignments?user.id=0aa4fe93a70b4770916eefac7a9f340f&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.589642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.606817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.654876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499182cf-05f9-4be2-b8b5-f1a6229d72fd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.694634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.695582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.696033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.696508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.698107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.699785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.701909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 60/125] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.702887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.720027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7f16-e1b1-4957-954c-ddd7667ba919 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.740222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.767192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.767835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.768206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.768712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.771029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.772742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.776305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 66/126] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.776305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.824776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f36a1-bcbb-45e2-b342-cc1a2c91943f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.860304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.861205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.861620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.862659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.863997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:00.865703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:00.867534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 61/127] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:00.868470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:00.887440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.914952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daee5-0aa5-4319-a304-03f74434cf6b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.960155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:00.960848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:00.961660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:00.962005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:00.975221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:00.980891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c4a7-b88b-4c43-b0e6-f9b7a820e4d9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:00.981013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:00.988009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:00.988916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:00.989688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 67/128] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:00.990343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.030080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.030748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.031027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.031298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/e11a64b92c2c4ad19b9140c791184bd8/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.033255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, user_id=e11a64b92c2c4ad19b9140c791184bd8, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.035792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.052505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 62/129] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:00 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/e11a64b92c2c4ad19b9140c791184bd8/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:01.053375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.178946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6d277-b5a0-464a-a23a-ce42b7a95379 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.202161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e39b8-2ba4-49e9-a5bd-c322778c36bc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.226308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.226888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.227176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.227454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.229618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.230928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.232927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 63/130] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:01 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:01.234422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.273718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:01.281513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.284325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.285141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.285666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] PATH_INFO: `/v3/projects/06be975c15624c959cf0632ea6c9d1f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.287012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] RBAC: Authorizing `identity:get_project(project_id=06be975c15624c959cf0632ea6c9d1f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.289272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.291875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 68/131] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:00 2022] GET /identity/v3/projects/06be975c15624c959cf0632ea6c9d1f9 => generated 312 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:01.293429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.307855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:01.377835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ad51d-dbdf-4480-ae04-cb02202eb902 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.425410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.426359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.426939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.427402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.428320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:01.428967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.430988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.440502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 64/132] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:01.441918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.477040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f064d8-689b-4088-9361-5dda25329f36 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.549278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.551476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.551976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.553742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/055098f463f14b67a24ad1d104cbba34/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.557972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, user_id=055098f463f14b67a24ad1d104cbba34, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.561002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.568403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:01.582857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66f0bf-bda8-478d-8720-ea6a5edd2eb9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.590908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 69/133] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:01 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/055098f463f14b67a24ad1d104cbba34/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:01.592329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.675067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.676806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.678010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.678669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] PATH_INFO: `/v3/projects/06be975c15624c959cf0632ea6c9d1f9/users/e11a64b92c2c4ad19b9140c791184bd8/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.683096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] RBAC: Authorizing `identity:create_grant(project_id=06be975c15624c959cf0632ea6c9d1f9, user_id=e11a64b92c2c4ad19b9140c791184bd8, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.686518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.714636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 65/134] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:01 2022] PUT /identity/v3/projects/06be975c15624c959cf0632ea6c9d1f9/users/e11a64b92c2c4ad19b9140c791184bd8/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:01.717314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:01.771185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5f73-a133-407e-9cad-6f6938297e4b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.819690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.820436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.820725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.820997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.822199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.823666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.825562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 70/135] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:01 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:01.831630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:01.943473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9eaa7-c70e-4508-a29c-de63edd0b194 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:01.981773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:01.982539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:01.982820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:01.983142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:01.984248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:01.985694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53e87-308b-4244-bd45-1f0869b1cba3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:01.988030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 66/136] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:01 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:01.993807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:02.113913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751c25-5b26-4468-a819-a4fe4aec8fbd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:02.155880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:02.156578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:02.156859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:02.157135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/e11a64b92c2c4ad19b9140c791184bd8/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:02.159429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, user_id=e11a64b92c2c4ad19b9140c791184bd8, role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:02.160916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1dd05-c737-4b95-a108-cb5625ffd8bf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:02.169225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:02.185905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 71/137] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:01 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/e11a64b92c2c4ad19b9140c791184bd8/roles/aea8cb3d868e426794cd392f72d51d71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:02.450816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68c80-8a55-4d42-9d16-cf72a4854e4d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:02.451530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68c80-8a55-4d42-9d16-cf72a4854e4d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:02.451530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68c80-8a55-4d42-9d16-cf72a4854e4d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:02.453069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 67/138] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:02.459562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a42b-8a79-4b6d-869b-dfb99140ab9c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:02.459855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a42b-8a79-4b6d-869b-dfb99140ab9c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:02.460145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2a42b-8a79-4b6d-869b-dfb99140ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:02.488783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73e2a42b-8a79-4b6d-869b-dfb99140ab9c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:02.489973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73e2a42b-8a79-4b6d-869b-dfb99140ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:02.570337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 72/139] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:03.074811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8bb-8444-45a7-b4d1-55a7a497f4ed None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.075162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8bb-8444-45a7-b4d1-55a7a497f4ed None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.075331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8bb-8444-45a7-b4d1-55a7a497f4ed None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.076676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 68/140] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:03.082623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.082913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.083183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.093198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff8bb-8444-45a7-b4d1-55a7a497f4ed None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:03.110016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:03.111205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:03.125874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:03.238920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 73/141] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:03.248683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff8bb-8444-45a7-b4d1-55a7a497f4ed None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:03.297307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:03.297943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.298223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.298495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.299629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:03.301095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d718d1-113c-4111-b43c-aa14b0b83337 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:03.302950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 69/142] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:03.308324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:03.382252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:03.432332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6daaaa-ae1c-474f-be77-5f10a3f78164 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:03.473118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:03.473772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.474054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.474329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.474968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:03.476424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e46b1-8c59-4716-81f7-b8ccafc35c9f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:03.507547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 74/143] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:03 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:03.782031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226ac3-f5b2-4c31-a0e9-03cbcf473b84 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.782668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226ac3-f5b2-4c31-a0e9-03cbcf473b84 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.782668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226ac3-f5b2-4c31-a0e9-03cbcf473b84 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.784505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 70/144] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:03.789907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:03.790197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:03.790471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:03.802748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226ac3-f5b2-4c31-a0e9-03cbcf473b84 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:03.818940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:03.819724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:03.937136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 75/145] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:03.937532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:03.961469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226ac3-f5b2-4c31-a0e9-03cbcf473b84 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.012348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.012901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.013177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.013457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.029978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:04.035176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:04.036010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:04.036794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 71/146] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:04.044115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.093475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:04.174471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3a6f-86b2-4deb-b263-d86d1efae040 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.219513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.220152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.220429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.220694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.222002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:04.222302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:04.223681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:04.233858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 76/147] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:04.239442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.251995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.407873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35897b-2295-4910-9ae7-517c98e6b15b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.430952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc416b1-ae87-4fcb-938c-1a9f66605f62 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.433475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:04.450385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.451349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.451795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.452681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] PATH_INFO: `/v3/users/0aa4fe93a70b4770916eefac7a9f340f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.454140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa4fe93a70b4770916eefac7a9f340f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:04.456422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb2da1-b9ae-4f82-a995-3e0fe3e3cb55 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:04.463447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 72/148] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/users/0aa4fe93a70b4770916eefac7a9f340f => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:04.465839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947e85-2307-46b0-a278-94803f74bb85 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.466472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947e85-2307-46b0-a278-94803f74bb85 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.466975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947e85-2307-46b0-a278-94803f74bb85 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.468836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 73/149] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:04.469757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c947e85-2307-46b0-a278-94803f74bb85 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.474777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.476253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.476253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.476253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.489620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:04.492464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2ed94d7d-067a-4127-814a-f46e16993a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:04.494360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:04.495203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:04.495962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 77/150] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:04.497262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.497544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.497820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.524888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:04.526022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:04.597007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c947e85-2307-46b0-a278-94803f74bb85 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.602868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 78/151] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:04.608004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.633906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.634850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.635314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.635789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.637109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:04.638741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:04.640954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 74/152] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:04.647481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.719304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:04.733274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3642d3-69aa-4e88-aedf-9238478e2257 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.736460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:04.758340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d002e-6aa2-45a8-a669-db6f5169199d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:04.776534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.777155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.777432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.777700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.778370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:04.778672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:04.780181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:04.789376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 79/153] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:04.801003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:04.801003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.801551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.801551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/0aa4fe93a70b4770916eefac7a9f340f/roles/9a09dc5ab5624c2c946940bbb22140a2` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.803354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, user_id=0aa4fe93a70b4770916eefac7a9f340f, role_id=9a09dc5ab5624c2c946940bbb22140a2)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:04.804757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec333-cfc7-4292-9267-257bfc3da34d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:04.810445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:04.826686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 75/154] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:04 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/users/0aa4fe93a70b4770916eefac7a9f340f/roles/9a09dc5ab5624c2c946940bbb22140a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:27:04.849434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2f60-5ed3-4496-a8a8-3fec2d88d342 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.849994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2f60-5ed3-4496-a8a8-3fec2d88d342 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.850641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc2f60-5ed3-4496-a8a8-3fec2d88d342 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.852548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 76/155] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:04.861734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a331-7eab-4117-9cee-0d953a4f89f5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:04.862561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a331-7eab-4117-9cee-0d953a4f89f5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:04.863087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589a331-7eab-4117-9cee-0d953a4f89f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:04.898581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3589a331-7eab-4117-9cee-0d953a4f89f5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:04.900379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3589a331-7eab-4117-9cee-0d953a4f89f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:05.026516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d54b0c-6d93-48da-a05f-d55c9edf6626 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.060096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 77/156] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:05.061283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953629-9a02-45fa-85b9-19371d868cd5 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.061568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953629-9a02-45fa-85b9-19371d868cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.061835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953629-9a02-45fa-85b9-19371d868cd5 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.063290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 78/157] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:05.069203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.069483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.069912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.083832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.085081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.085574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.086034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.087435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:05.088716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:05.089436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:05.090102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:05.091382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 80/158] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:04 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:05.097178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.136782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.180835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 79/159] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:05.223898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.226747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.230238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b0a7-eaa0-4403-957c-a6792fe20534 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.273525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.274663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.275382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.275860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.365787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:05.367910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:05.407965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.459943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e04e-7760-4a1c-ba3d-0b7b2bfbde9a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.523235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 81/160] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:27:05.528808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.541795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.542438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.542711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.542981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.572952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:05.577658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:05.578600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:05.579383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 80/161] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:05.586737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.682685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945904-8367-4187-a5be-6d974b4a1fd2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.701666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.743535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96553-be4e-4f62-a27d-13b2eaeea994 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.753617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.782405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.783348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.784181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.784684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.784973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.785779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.786041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:05.786138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.786315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.786789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:05.788515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:05.788691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:05.790311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:05.792294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 82/162] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:05.793081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.798871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 81/163] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:05.800490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:05.904415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082b89-fd90-432e-bb9d-608f63e8faeb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:05.930121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:05.948162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:05.948162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:05.948162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:05.948162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:05.973641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:05.978926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:05.979819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:05.980639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 82/164] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:05.988988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.064808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677201-8a67-43fe-a755-86e1d1edbd15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.140910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.141593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.141894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.142167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.188708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:06.193607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:06.194715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 83/165] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:06.195506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.236202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82277ed4-5e22-40f7-8bc8-fe53a0fd9f95 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.294133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.294756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.295036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.295307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.296035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:06.296365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.297822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.304069 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:06.309990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 83/166] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:05 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=3524ec8100184d48956522845b1fbebe => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:06.310904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.368524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:06.398493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fb63-d918-4a18-aab4-970c658e525e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.424663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0dd60-82b0-4304-86e6-817e2b2d28d6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.459203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.459743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.460027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.460331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] PATH_INFO: `/v3/users/055098f463f14b67a24ad1d104cbba34` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.461912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] RBAC: Authorizing `identity:get_user(user_id=055098f463f14b67a24ad1d104cbba34)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.463419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.465105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 84/167] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/users/055098f463f14b67a24ad1d104cbba34 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:06.467494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.468147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.468445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.468775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.469369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:06.469757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.471755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.474221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.485530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 84/168] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:06.491112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.642432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef9e4-746d-4a6a-9f43-b51ccadf12f5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.653863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:06.663724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23449-78b7-4815-8c11-db995df3a2ca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.684921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.685623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.685961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.686294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.700410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:06.726283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.727047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.727399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.727734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.728512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:06.728883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.730592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.741214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 85/169] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:06.742417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:06.861176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.862724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.921067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b01d1-14b9-47d1-bb37-628a2129f374 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:06.985758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:06.986511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:06.986896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:06.987240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:06.989947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:06.991692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:06.995375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 86/170] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:06.996418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.085905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.135060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 85/171] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:07.135754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.163775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.179725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7d54b-ef39-42da-854c-b158763cdad5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:07.238262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:07.238901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.239296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.239570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] PATH_INFO: `/v3/users/e11a64b92c2c4ad19b9140c791184bd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.240751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] RBAC: Authorizing `identity:get_user(user_id=e11a64b92c2c4ad19b9140c791184bd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:07.242252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:07.248173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 87/172] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:06 2022] GET /identity/v3/users/e11a64b92c2c4ad19b9140c791184bd8 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:07.249966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.383110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144b561-1c58-48ad-8f56-49fcc1932b8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:07.435252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36d55d-0cff-4a86-bf5f-4400b35cb01e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:07.464446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.473446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:07.474093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.474375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.474649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.475783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:07.477757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:07.479775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 88/173] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:07 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:07.480585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.496836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:07.497397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.497689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.497952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.610763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7daa-771b-4a3c-8142-1634199b2932 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:07.647694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:07.648361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.648649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.648926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.661135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:07.662630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e68c-9790-40d0-860f-19f085826d0f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:07.681332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.756492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.783306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 86/174] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:07.789337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516c87-0972-49c6-8f24-40857b821125 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.789629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516c87-0972-49c6-8f24-40857b821125 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.789910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516c87-0972-49c6-8f24-40857b821125 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.791218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 87/175] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:07.791932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516c87-0972-49c6-8f24-40857b821125 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.792961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:07.794439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:07.901649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516c87-0972-49c6-8f24-40857b821125 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:07.937583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:07.939111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.939609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.940101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.941430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=055098f463f14b67a24ad1d104cbba34) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:07.942053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:07.944074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f454ac-00d9-4185-b0f3-6b52db33621c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:07.948344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 89/176] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:07.953050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:07.957190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 88/177] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:07 2022] GET /identity/v3/role_assignments?user.id=055098f463f14b67a24ad1d104cbba34&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:07.957190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:07.962064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffeb3-5302-4aeb-9327-2a66b580ffb5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:07.962341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffeb3-5302-4aeb-9327-2a66b580ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:07.962613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ffeb3-5302-4aeb-9327-2a66b580ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:07.995771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b54ffeb3-5302-4aeb-9327-2a66b580ffb5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:07.997036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b54ffeb3-5302-4aeb-9327-2a66b580ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:08.070689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 89/178] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:08.071666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ff6a-edc0-48aa-a0ad-15e4c2818bd2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.071949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ff6a-edc0-48aa-a0ad-15e4c2818bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.072293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672ff6a-edc0-48aa-a0ad-15e4c2818bd2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.073682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 90/179] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:08.074219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ff6a-edc0-48aa-a0ad-15e4c2818bd2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.121480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.151239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20ddf9-9514-449b-9f49-b215e4578e82 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.182685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672ff6a-edc0-48aa-a0ad-15e4c2818bd2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.185494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.215956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.216624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.216900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.217193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] PATH_INFO: `/v3/projects/06be975c15624c959cf0632ea6c9d1f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.219204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] RBAC: Authorizing `identity:get_project(project_id=06be975c15624c959cf0632ea6c9d1f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:08.220700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40bc83-45df-4828-83a5-3a54c58a8f09 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:08.222904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 90/180] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:07 2022] GET /identity/v3/projects/06be975c15624c959cf0632ea6c9d1f9 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:08.224020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.228449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.228732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.237638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.238583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.239061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.239532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.240905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:08.243103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f379b21-44f4-4a3d-a059-786bca389912 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:08.245298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 91/181] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:08.246807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86b4e-1ed1-4d1d-985e-ad5c1bd91066 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.247293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86b4e-1ed1-4d1d-985e-ad5c1bd91066 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.247522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:08.248019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf86b4e-1ed1-4d1d-985e-ad5c1bd91066 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.248744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:08.250226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 92/182] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:08.251742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86b4e-1ed1-4d1d-985e-ad5c1bd91066 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.338045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 91/183] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:08.338913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.390515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf86b4e-1ed1-4d1d-985e-ad5c1bd91066 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.434306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.438380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.438995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.439339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.440389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.441473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=06be975c15624c959cf0632ea6c9d1f9, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:08.441789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:08.443226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eef898-838c-4240-8901-ec17d37bcf14 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:08.452227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 93/184] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=06be975c15624c959cf0632ea6c9d1f9&role.id=3524ec8100184d48956522845b1fbebe => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:08.453456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972832-6195-4564-8869-b0cfe10a8004 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.456255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972832-6195-4564-8869-b0cfe10a8004 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.456562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972832-6195-4564-8869-b0cfe10a8004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.458189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2d60-febb-4817-8a16-0cbfdeba246a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.476743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-72972832-6195-4564-8869-b0cfe10a8004 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:08.478140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-72972832-6195-4564-8869-b0cfe10a8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:08.498205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.499709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.500233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.500727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.501693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=e11a64b92c2c4ad19b9140c791184bd8) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:08.502745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:08.504586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8a12-706f-4f6e-a99e-733a5d18d71a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:08.511850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 92/185] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/role_assignments?user.id=e11a64b92c2c4ad19b9140c791184bd8&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:08.513577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3debb0-ff40-47a2-916a-93f48112d559 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.514056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3debb0-ff40-47a2-916a-93f48112d559 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.514924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.515397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3debb0-ff40-47a2-916a-93f48112d559 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.518444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 93/186] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:08.524200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3debb0-ff40-47a2-916a-93f48112d559 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.561410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 94/187] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:08.568107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.568107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.568107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.603296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:08.604156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:08.704016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3debb0-ff40-47a2-916a-93f48112d559 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.728485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 95/188] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:08.730026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.741598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.742240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.742523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.742800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.756782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:08.763543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:08.764516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:08.765454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 94/189] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:08.773995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.786779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.841762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:08.851830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadab66-26a6-4e9d-b95c-dab7edaf1c80 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.887133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d3b20-3710-414c-8db9-2fee6b7f248d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:08.890477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.891289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.891713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.892176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.903654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:08.908856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:08.909956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:08.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:08.913224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 96/190] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:08.919375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:08.933711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:08.934333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:08.934610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:08.934875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:08.935543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:08.935843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:08.937235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:08.946343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 95/191] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:08.949639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.038488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.041323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65672689-e384-4525-8892-d3d1579114c3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.070570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e624-eae8-45b3-911e-9788cc19d1f1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.075234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.075836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.076141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.076415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.077073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:09.077378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.078769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.086630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 97/192] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:09.091569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.104836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.105466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.105748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.106019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.106970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.116746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:09.121840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:09.122887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:09.123860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:09.128098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 96/193] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:09.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.188410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867d02-418e-42c5-b8fd-58d8f6171dca None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.220161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.220785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.221590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.221864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.224472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bd16f-fb0b-4d48-9f51-0dfa60352ac0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.234396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.235846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.238032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 98/194] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:09.243326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.252954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.259264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.259882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.260192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.260464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.261549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.262983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.264540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 97/195] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:09.268916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.319444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.341824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cd37c-efeb-4108-a0b6-cf29d9f9470d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.367801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78225a00-f773-4ccd-b4d7-d80216063030 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.375606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.376266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.376553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.376823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] PATH_INFO: `/v3/users/0aa4fe93a70b4770916eefac7a9f340f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.377987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] RBAC: Authorizing `identity:get_user(user_id=0aa4fe93a70b4770916eefac7a9f340f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.379421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.381234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 99/196] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/users/0aa4fe93a70b4770916eefac7a9f340f => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:09.381796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.405380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.406185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.406468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.406741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.407399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:09.407709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.409660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.417316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 98/197] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:09.418068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.475713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.480852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfbfbe-7754-4a4c-b287-9a224fe8c05b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.513489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.514094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.514406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.514683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.515649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577938-19ab-45f1-b9bf-769bb7fb1c33 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.529766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.548942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.549583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.549848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.550125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.550758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.552210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.571751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 99/198] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:09 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:09.572679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.591066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.592613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.690210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e5c78-9f1b-4608-aa6b-b8645501c185 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.709036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.718549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 100/199] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:09.718549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.740917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.741786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.742242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.742700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.771834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:09.825463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.826945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.842774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4149-c412-497c-a4a8-d10a14d72a03 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:09.888548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:09.889259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:09.889535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:09.889855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:09.893352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:09.894971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:09.897075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 101/200] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:09.898007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.956156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 100/201] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:09.957327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:09.980533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.019531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03fcb1-d5ed-4d6e-af86-c904e8a34243 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.033854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.057517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.058260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.058962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.059505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.061144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.062802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.065368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 102/202] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:10.066220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:10.089253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2905f-4cea-4759-9b33-42288fa95f4d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.140258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.141140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.141418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.141688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.184680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdc888-9f17-4056-bfcd-16f99b33b2b7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.223750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.224476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.224866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.225206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.226576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.228275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.230515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 103/203] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:10 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:10.231502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:10.232680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.234442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.261367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.287566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.343003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd6b08-e2ed-4fe7-a2c3-2ee990c20287 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.375969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 101/204] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:10.376991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:10.384623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.385233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.385513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.385785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.386508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=edba08f7f8c841239f1ba9333f2eb31a) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:10.386873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.388917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.396085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 104/205] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:10 2022] GET /identity/v3/role_assignments?user.id=edba08f7f8c841239f1ba9333f2eb31a&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:10.397271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:10.568586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71489-4bb6-431f-933c-02027607e209 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.584983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d596-a644-4a73-9896-350aef7acc2b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.591108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.602013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:10.623789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.623789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.623789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.623789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.624485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, scope.project.id=badda7d5a32546ec8b95ecc67718f53f, user.id=0aa4fe93a70b4770916eefac7a9f340f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:10.624485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.624485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.628635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 102/206] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:10 2022] GET /identity/v3/role_assignments?user.id=0aa4fe93a70b4770916eefac7a9f340f&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:10.662308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.663219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.663666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.664099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.665463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.667082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fa94e-fee1-47c4-b07a-625daedc4454 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.669216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 105/207] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:10 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:10.675846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:10.832993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86551128-3ee9-474b-8dfe-9c62364b132e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:10.882541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:10.883156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:10.883433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:10.883701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:10.884441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=edba08f7f8c841239f1ba9333f2eb31a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:10.884744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:10.886180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99747aa-1e98-4586-a844-a14da4070e4d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:10.894639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 103/208] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:10 2022] GET /identity/v3/role_assignments?user.id=edba08f7f8c841239f1ba9333f2eb31a&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:11.700694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb1fb1-71c2-45d0-9bca-c9956dbfcf61 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:11.701690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb1fb1-71c2-45d0-9bca-c9956dbfcf61 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:11.702185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb1fb1-71c2-45d0-9bca-c9956dbfcf61 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:11.703714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 106/209] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:11.708836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:11.709322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:11.709791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:11.731065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:11.732488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:11.757513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184a37-95cd-4978-b0fe-411e453f82f0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:11.757789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184a37-95cd-4978-b0fe-411e453f82f0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:11.758058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14184a37-95cd-4978-b0fe-411e453f82f0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:11.759675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 107/210] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:11.764364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:11.764649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:11.764925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:11.776833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:11.785913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:11.785913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:11.811289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 104/211] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:11.858947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 108/212] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:12.079049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.141084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.188670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e84dd-3ecd-4840-bde2-54586311bf37 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.225478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.226183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.226470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.226741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.238277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:12.243363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:12.244281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:12.245084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:12.245696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc887c-c77a-45d1-a41c-ca62501cd95b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.245774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 105/213] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:12.250398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.256732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:12.282393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.283229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.284136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.284481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.285749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:12.287378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:12.289185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 109/214] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:12.292668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:12.294553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.378852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a6bd4-58cc-4ca9-85ae-21b72847ecbe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.426738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.427369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.427646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.427920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.428605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:12.428905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:12.429752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746859a-9557-4ad7-b174-de374f883c15 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.430277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1692f-5c6b-4731-b527-032aa4f75a9c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:12.443357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 106/215] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:12.443357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e30b-aa43-4574-ac4a-d5dc4f44f660 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.443357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e30b-aa43-4574-ac4a-d5dc4f44f660 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.443357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4e30b-aa43-4574-ac4a-d5dc4f44f660 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.443357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 107/216] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:12.444466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e30b-aa43-4574-ac4a-d5dc4f44f660 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.474667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.475747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.476254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.476673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.477770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:12.479651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43127fd-01ae-4428-a3a5-c66ada25bc50 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:12.516094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 110/217] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:12 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:12.516094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.516094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.516094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.541041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:12.542346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:12.555101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:12.563794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4e30b-aa43-4574-ac4a-d5dc4f44f660 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.590671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:12.617179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.618683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.619420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.619894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] PATH_INFO: `/v3/users/479eccc65f764a8da3774b13eade781f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.639950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 111/218] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:12.643519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=479eccc65f764a8da3774b13eade781f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:12.645371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56b557-e9de-4521-b0a2-e78c88dce5a8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:12.647651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 108/219] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/users/479eccc65f764a8da3774b13eade781f => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:12.655876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.761401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9a765-8896-4129-9cb2-6e036c827cdb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:12.797354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:12.797982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.798394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.798666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.833073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:12.839471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ed06b-2429-433c-8ecf-3dba8ced5670 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.839759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ed06b-2429-433c-8ecf-3dba8ced5670 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.840039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ed06b-2429-433c-8ecf-3dba8ced5670 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.841406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 109/220] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:12.846536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:12.846824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:12.847099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:12.875393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:12.877766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:12.877898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:12.879262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:12.958081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 110/221] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:12.958939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:12.997943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 112/222] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:13.004427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.075513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.086494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.096360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb429d0-fc4b-45e4-898b-0c429b3807a3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.131994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fa2ab-26cb-4c51-adb6-c672ee69c4e1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.133203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.134017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.134441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.134845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.145944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:13.150930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:13.151787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:13.152597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:13.154803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 111/223] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:13.161131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.182614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.183257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.183535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.183807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.185851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.187304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.189547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 113/224] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:13.195088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.307273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cdda2-660f-4405-889e-14f7c0a7f939 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.320229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de7eb5-f06d-471a-90bd-311eeb27c123 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.340424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.345028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.345856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.346702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.346979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.347807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=479eccc65f764a8da3774b13eade781f) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:13.348935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.350591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.355075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.355685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.355961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.356257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.356934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 114/225] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/role_assignments?user.id=479eccc65f764a8da3774b13eade781f&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=3524ec8100184d48956522845b1fbebe => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:13.357048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:13.357208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.357640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.358577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.372572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 112/226] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:13.373528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.383282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.481942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a3a4-30c9-4cb3-afb1-85c7518fa801 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.483972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5718-cf86-42b2-a0e7-b3f3d05f78ab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.528326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.529066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.529411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.529753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.531050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.534700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.535376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 113/227] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:13.540876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.561669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.562577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.563024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.563489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.582636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:13.587898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:13.588805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:13.589588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 115/228] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:13.595281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.630701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.658797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2ee89-e2c7-439d-9736-f5a3d7addddb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.695750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.696880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.697165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.697442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.698725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.700213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.702141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 114/229] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:13.708589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.716834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:13.833878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4b1b-faf4-4159-9a63-6791eca8da23 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.870644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.871368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.871657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.871932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/edba08f7f8c841239f1ba9333f2eb31a/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.874662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, user_id=edba08f7f8c841239f1ba9333f2eb31a, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.876119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.885615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83896b-4a69-456a-9657-bb90dfe4fac8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:13.892390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 115/230] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:13 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/edba08f7f8c841239f1ba9333f2eb31a/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:13.967640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:13.968304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:13.968581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:13.968852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:13.969539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:13.969839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:13.971347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:13.988015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 116/231] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:13.994012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:13.997065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:14.150990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01942-9303-4a9e-9a9f-81ed731d7cf2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:14.187688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:14.188397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:14.188681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:14.188952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:14.190621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:14.192082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:14.193998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 116/232] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:13 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:14.199469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:14.311742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43eb0-25cc-4973-b5b7-df3afda77ce5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:14.336915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:14.356471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:14.357153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:14.357432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:14.357702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:14.358866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:14.360347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507c4f-2ba0-4d4d-934a-9b6032e82434 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:14.362534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 117/233] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:14 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:14.368220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:14.473085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:14.514829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296c78-2918-429d-ac0a-4514f5381e16 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:14.548257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:14.549488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:14.549775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:14.550046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/edba08f7f8c841239f1ba9333f2eb31a/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:14.552228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, user_id=edba08f7f8c841239f1ba9333f2eb31a, role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:14.553678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded579e-f228-4464-90ee-2aff0d0a6c93 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:14.576297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 117/234] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:14 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/edba08f7f8c841239f1ba9333f2eb31a/roles/aea8cb3d868e426794cd392f72d51d71 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:14.913364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f002-4863-4e29-a151-d75ac7749d7e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:14.913861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f002-4863-4e29-a151-d75ac7749d7e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:14.913936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252f002-4863-4e29-a151-d75ac7749d7e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:14.915232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 118/235] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:14.920424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e85ef-aa8d-4985-89e2-d1bbd678175d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:14.920708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e85ef-aa8d-4985-89e2-d1bbd678175d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:14.920984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e85ef-aa8d-4985-89e2-d1bbd678175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:14.940552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3b1e85ef-aa8d-4985-89e2-d1bbd678175d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:14.941736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b1e85ef-aa8d-4985-89e2-d1bbd678175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:15.010639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 118/236] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:15.156360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19eb0e-094f-448c-abf0-be7a60b4ef67 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.156721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19eb0e-094f-448c-abf0-be7a60b4ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.156903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19eb0e-094f-448c-abf0-be7a60b4ef67 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.158278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 119/237] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:15.169549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.170002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.170110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.194103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:15.195267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:15.252791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:15.268541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 119/238] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:15.332997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19eb0e-094f-448c-abf0-be7a60b4ef67 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:15.436380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19eb0e-094f-448c-abf0-be7a60b4ef67 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:15.480797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:15.481432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.481750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.482027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.495863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:15.500973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:15.501870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:15.503290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 120/239] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:15.508693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:15.637616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aeb87-01d7-4bd0-83a4-5c55d9e3e5ee None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:15.682615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:15.683326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.683606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.683875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.684587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:15.684892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:15.686344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:15.699770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 120/240] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:15.705158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:15.757325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:15.787900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:15.820348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:15.880213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7b6f-02c0-4178-854d-77291f76ef44 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:15.882702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f67af-7ef1-48d4-a7ce-5e29c1042e82 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:15.921725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:15.922365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.922832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.923096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:15.923569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.924927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:15.925150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.925557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.925977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] PATH_INFO: `/v3/users/60e202cd6def4deca7316e2e427cdbaf` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.926366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b330c41-8b61-4c60-85a5-e190aed1080c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:15.928221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 121/241] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:15.929669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4828-c626-437b-85ce-90493e45e463 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.930195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4828-c626-437b-85ce-90493e45e463 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.930605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4828-c626-437b-85ce-90493e45e463 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.935927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 122/242] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:15.936902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4828-c626-437b-85ce-90493e45e463 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:15.946240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] RBAC: Authorizing `identity:get_user(user_id=60e202cd6def4deca7316e2e427cdbaf)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:15.948304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac194be7-66d3-4b64-8717-452f0c3ad87d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:15.955103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 121/243] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:15 2022] GET /identity/v3/users/60e202cd6def4deca7316e2e427cdbaf => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:15.955103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:15.955103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:15.955103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:15.974984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:15.976451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:16.049861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 122/244] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:16.051211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.073327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4828-c626-437b-85ce-90493e45e463 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.096604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.106158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.123502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.124373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.124657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.124922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.125559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:16.127025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41793593-df7d-4762-85cd-d06b64b970a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:16.166368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 123/245] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:15 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:16.219409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36edfc-7b9f-48e7-8bb6-13f62cff0777 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.276510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.277236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.277518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.277790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.364693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:16.366157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:16.397615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e0d7-c15e-48a7-8578-c952975fc42c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.398547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e0d7-c15e-48a7-8578-c952975fc42c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.398915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e0d7-c15e-48a7-8578-c952975fc42c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.400399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 124/246] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:16.401453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.407327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.407677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.407957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.434833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:16.436024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:16.482534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 123/247] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:16.483595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.523194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 125/248] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:16.524076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.601335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20038069-d887-4026-bd1d-cdeba7727759 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.643148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.644025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.644469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.644961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.647790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.659151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:16.664565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679df76e-61e3-4082-9004-a08a703c85e6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:16.665708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:16.666782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:16.667735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:16.669934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 124/249] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:16.675031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.677021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.714001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.714645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.714920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.715344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.716839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:16.718958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:16.720828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 126/250] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:16.727612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.806706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671b5e8-4642-43bb-b24f-100744e61acf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.847940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.848817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.849339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.849849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.850654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:16.851100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:16.852662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa87d6-7055-46a1-9a84-21d645cff042 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:16.852819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:16.863219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 125/251] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:16.869249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.894752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:16.895366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:16.895639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:16.895929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:16.899186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=60e202cd6def4deca7316e2e427cdbaf) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:16.899523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:16.901731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:16.909816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 127/252] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/role_assignments?user.id=60e202cd6def4deca7316e2e427cdbaf&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:16.917289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:16.938123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:16.998178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb434f-f19a-4978-a861-3250e2210e27 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.013217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:17.043470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.044441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.044866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.045835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] PATH_INFO: `/v3/users/479eccc65f764a8da3774b13eade781f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.047377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] RBAC: Authorizing `identity:get_user(user_id=479eccc65f764a8da3774b13eade781f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:17.049605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:17.055298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 126/253] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/users/479eccc65f764a8da3774b13eade781f => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:17.059086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:17.167110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be0f1e-dcff-4e2f-b5ea-74ec132db429 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.192717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b520-5755-40fc-b956-31426e05019c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.216091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:17.226999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.227642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.227908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.228208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.229327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:17.230775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b0ac-cc95-4693-ab7b-b1fffcffc8fe None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:17.233149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 127/254] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:17 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:17.233957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ed15-c03d-4cd5-bb2e-e363db5f7b8e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.234241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ed15-c03d-4cd5-bb2e-e363db5f7b8e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.234500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6ed15-c03d-4cd5-bb2e-e363db5f7b8e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.235821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 128/255] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:17.240775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ed15-c03d-4cd5-bb2e-e363db5f7b8e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:17.249926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.250676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.250960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.251231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.279069 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1be7cb71-f350-47d8-9752-2375dc8d4da6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:17.284880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:17.285807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:17.286606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 128/256] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:17.292902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.293191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.293465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.325655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:17.326767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:17.351564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6ed15-c03d-4cd5-bb2e-e363db5f7b8e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.391067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.392114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.392673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.393195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/479eccc65f764a8da3774b13eade781f/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.395914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, user_id=479eccc65f764a8da3774b13eade781f, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:17.397807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:17.413284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 129/257] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:17 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/479eccc65f764a8da3774b13eade781f/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:17.414584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:17.483020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:17.495671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 129/258] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:17.544300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabd4b-7fff-4eab-81c0-de93414ee038 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.583750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.586169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.586664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.587175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.588081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:17.588593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:17.590211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:17.600779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 130/259] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:17.606587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:17.637829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:17.727641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74bf6-5a9e-4c16-87d9-9f901cf6f4cc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.775332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.775984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.776292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.776562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.777699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:17.779151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:17.781209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 130/260] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:17 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:17.787197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:17.927904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62affe9-3ec4-410e-b214-3bf75ee6c0f7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:17.948205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:17.974306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:17.974914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:17.975192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:17.975465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:17.989280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.107434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:18.109977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:18.164970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:18.186251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c688-9227-4a51-8a7a-ee64b5a856d1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:18.254393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:18.255033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:18.255311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:18.255580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:18.278793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:18.283588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:18.284499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:18.285295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 131/261] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:18.291717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.328595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 131/262] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:18.338042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.377881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:18.446001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5264-fda9-40fc-a5b6-60049224b026 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:18.504756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:18.505410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:18.505635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:18.505909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:18.506572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:18.506874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:18.508278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:18.520689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 132/263] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:18.525857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.558316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:18.602767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a554698-5020-4ba1-97f3-4972e1688060 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:18.685741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232791cf-8ed6-4323-8e65-df10b0644f8c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:18.696811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:18.697391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:18.697673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:18.697943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:18.699089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:18.700559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:18.702508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 132/264] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:18 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:18.708752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.742052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:18.742700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:18.742979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:18.743252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] PATH_INFO: `/v3/users/edba08f7f8c841239f1ba9333f2eb31a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:18.748780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] RBAC: Authorizing `identity:get_user(user_id=edba08f7f8c841239f1ba9333f2eb31a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:18.750509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:18.752485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 133/265] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:18 2022] GET /identity/v3/users/edba08f7f8c841239f1ba9333f2eb31a => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:18.757979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:18.929206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:18.948475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:18.971961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad8516-7032-4299-8333-43a20284b050 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:18.982193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac562-8bc2-44bd-9ddb-f2c3dce9d951 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:19.053700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:19.054333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.054614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.054886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.060214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:19.060829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.061104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.061378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.062103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=edba08f7f8c841239f1ba9333f2eb31a) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:19.062405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:19.063991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:19.078493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 133/266] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:18 2022] GET /identity/v3/role_assignments?user.id=edba08f7f8c841239f1ba9333f2eb31a&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:19.167705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:19.169238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b470-6b22-4a7f-95e1-dc43b8bd129d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:19.285741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:19.302781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 134/267] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:27:19.308616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:19.409131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad209-6932-4ccb-8659-275641e2439c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.409450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad209-6932-4ccb-8659-275641e2439c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.409684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ad209-6932-4ccb-8659-275641e2439c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.411258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 135/268] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:19.416317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546072-a692-45f1-8aac-7e90db063942 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.416601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546072-a692-45f1-8aac-7e90db063942 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.416873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546072-a692-45f1-8aac-7e90db063942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.453076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-96546072-a692-45f1-8aac-7e90db063942 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:19.454328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96546072-a692-45f1-8aac-7e90db063942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:19.482002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40cd41-68af-40fd-b90d-e99084cbef05 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:19.521520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:19.522277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.522746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.523086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.524336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:19.526079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779d874-5359-4a05-a1ec-b4244894d649 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:19.528359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 134/269] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:19 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:19.529631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412908a-5bbc-4bb8-a896-cd8f2a01c479 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.529983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412908a-5bbc-4bb8-a896-cd8f2a01c479 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.530327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412908a-5bbc-4bb8-a896-cd8f2a01c479 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.531674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 135/270] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:19.534910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 136/271] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:19.541701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7542d-e9af-4a5d-9da4-142718a0056f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.541918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7542d-e9af-4a5d-9da4-142718a0056f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.542197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7542d-e9af-4a5d-9da4-142718a0056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.546634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546072-a692-45f1-8aac-7e90db063942 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:19.563928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9bc7542d-e9af-4a5d-9da4-142718a0056f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:19.565181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9bc7542d-e9af-4a5d-9da4-142718a0056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:19.578361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:19.651491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 136/272] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:19.657369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8aa5-0bef-4743-b9cd-378479b48d78 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.657899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8aa5-0bef-4743-b9cd-378479b48d78 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.658936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f8aa5-0bef-4743-b9cd-378479b48d78 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.660743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 137/273] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:19.666600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.667569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.668048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.689740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:19.691410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:19.767575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 138/274] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:19.791699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546072-a692-45f1-8aac-7e90db063942 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:19.819882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:19.859609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:19.860250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:19.860524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:19.860789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:19.862047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=edba08f7f8c841239f1ba9333f2eb31a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:19.862347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:19.863786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:19.869728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:19.878319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 137/275] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:19 2022] GET /identity/v3/role_assignments?user.id=edba08f7f8c841239f1ba9333f2eb31a&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:19.969547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:19.976282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.010844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d77b8-c86f-4ddc-ae05-f9af24cbcca7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.078615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.079182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.079456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.079723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.107810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:20.113327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:20.114193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:20.115009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 139/276] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:20.115721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.128431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94074f-476e-4a40-b10a-a6d576fa6b04 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.165294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.165947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.166229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.166508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.177485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:20.182714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:20.183614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:20.184467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 138/277] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:20.185111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.232836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f460738-ee1d-43cb-9973-e87e01e7d91a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.235588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.269185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.270067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.270482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.270904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.272152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.273802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.275492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 140/278] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.276402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.279181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.305034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aaab6-09df-4689-928e-703b295dffa9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.339506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.340037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.340355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.340627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.341277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:20.341577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.342939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.350769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 139/279] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.351518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.377931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e10f8e-7c08-4a53-ba94-628a0e746a2f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.410240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.410840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.411117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.411394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.412049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:20.412377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.413750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8a9de-1391-42bd-b4dc-97461c31c9a7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.421574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 141/280] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.422702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84c06-8750-43ed-9c13-f1ab21d209ab None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.422988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84c06-8750-43ed-9c13-f1ab21d209ab None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.423264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae84c06-8750-43ed-9c13-f1ab21d209ab None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.424534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 142/281] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:20.425222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae84c06-8750-43ed-9c13-f1ab21d209ab None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.451314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81384-520a-450c-bb6e-fdc53f4b3d01 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.452823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.486745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.487341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.487615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.487889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.487992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.488571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.489993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.510827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 140/282] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:20 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:20.511622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.531748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae84c06-8750-43ed-9c13-f1ab21d209ab None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.573887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.574681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.575023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.575299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] PATH_INFO: `/v3/users/f18adaf9d9b447e6941f3f85e85494cc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.593249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f18adaf9d9b447e6941f3f85e85494cc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.594686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d1399-218f-40cc-8289-73229fb9f0c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.596975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 143/283] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/users/f18adaf9d9b447e6941f3f85e85494cc => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.598300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.598581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.598847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.617098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:20.618311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:20.634211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2281c7-e966-4d68-9568-2b3ba7d1fe39 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.680478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.681830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.681830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.681830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] PATH_INFO: `/v3/users/60e202cd6def4deca7316e2e427cdbaf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.682847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=60e202cd6def4deca7316e2e427cdbaf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.684733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.686429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 141/284] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/users/60e202cd6def4deca7316e2e427cdbaf => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.686748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.702338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 144/285] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:20.703597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:20.724296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.773594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:20.829396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d74162-bb31-42aa-a847-bfde17429cb1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.841177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1529cd2-129c-4a21-a383-677a92a800d4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:20.870074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.870698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.871093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.871468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.872335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, user.id=f18adaf9d9b447e6941f3f85e85494cc, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:20.872743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.874544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.880542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:20.881418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:20.881770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 142/286] 10.222.0.73 () {56 vars in 1308 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/role_assignments?user.id=f18adaf9d9b447e6941f3f85e85494cc&scope.system=all&role.id=3524ec8100184d48956522845b1fbebe => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.882000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:20.882280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:20.883488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:20.885243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:20.886735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 145/287] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:20 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:20.892821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:21.011162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:21.014615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:21.030215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b085558-1120-45a3-b814-af5586ac8f22 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:21.070591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:21.071381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:21.071910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:21.071910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/60e202cd6def4deca7316e2e427cdbaf/roles/9a09dc5ab5624c2c946940bbb22140a2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:21.073902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, user_id=60e202cd6def4deca7316e2e427cdbaf, role_id=9a09dc5ab5624c2c946940bbb22140a2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:21.075423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:21.094839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 143/288] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:20 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/users/60e202cd6def4deca7316e2e427cdbaf/roles/9a09dc5ab5624c2c946940bbb22140a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:21.179255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fac3-b0ab-4fff-9db4-97c916b0d3b9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:21.208233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:21.228954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:21.229597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:21.229873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:21.230137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:21.249357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:21.254230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:21.255141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:21.255948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 146/289] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:21.261312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:21.375522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b81f-1c2e-4198-b95e-d38cc4a6f53e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:21.412419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:21.413389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:21.413864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:21.414327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:21.415238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:21.415751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:21.417350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:21.426691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 144/290] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:21.431979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:21.583068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6d08-3078-44d8-a0f5-7614a7013ef3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:21.629130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:21.629765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:21.630043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:21.630313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] PATH_INFO: `/v3/users/479eccc65f764a8da3774b13eade781f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:21.631450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] RBAC: Authorizing `identity:get_user(user_id=479eccc65f764a8da3774b13eade781f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:21.632917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:21.634778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 147/291] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:21 2022] GET /identity/v3/users/479eccc65f764a8da3774b13eade781f => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:21.640466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:21.665791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:21.765089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c4138-0bf7-4577-a126-ae26d45cd404 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:21.807076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:21.807695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:21.807975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:21.808270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:21.881259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:21.882900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:21.897985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:22.016135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 145/292] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:22.021759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:22.098086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:22.172562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00c43-17da-4282-a803-8167e4ab0558 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:22.216673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:22.217303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:22.217581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:22.217850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:22.218957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:22.220423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bf10c-a1f9-46ca-bc9b-f77adae36260 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:22.222243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 148/293] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:22 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:22.227907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:22.380745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b0dc-2c64-464a-ad90-89f7a38f34d0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:22.402685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:22.427964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:22.428596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:22.428876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:22.429148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:22.429874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=479eccc65f764a8da3774b13eade781f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:22.430179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:22.431619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ebe6-6c1a-42b4-9051-f16fbfb4254c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:22.441298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 146/294] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:22 2022] GET /identity/v3/role_assignments?user.id=479eccc65f764a8da3774b13eade781f&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=3524ec8100184d48956522845b1fbebe => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:23.003274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508414-0eac-4ca2-b5ad-c57713efb785 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.003462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508414-0eac-4ca2-b5ad-c57713efb785 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.003723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d508414-0eac-4ca2-b5ad-c57713efb785 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.005388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 149/295] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:23.011801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8c42-c95c-49d5-93fd-422a755a56cd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.012684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8c42-c95c-49d5-93fd-422a755a56cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.013200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8c42-c95c-49d5-93fd-422a755a56cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.034430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1d9e8c42-c95c-49d5-93fd-422a755a56cd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:23.035953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1d9e8c42-c95c-49d5-93fd-422a755a56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:23.070190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3ad5-5de2-4dbc-9b64-42daf78ee570 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.070688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3ad5-5de2-4dbc-9b64-42daf78ee570 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.070792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3ad5-5de2-4dbc-9b64-42daf78ee570 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.072036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 150/296] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:23.077473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.077852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.078024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.100326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:23.101802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:23.116449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 147/297] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:23.159536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba7d0-3179-43e5-a82e-a62437d303e2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.160320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba7d0-3179-43e5-a82e-a62437d303e2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.160816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba7d0-3179-43e5-a82e-a62437d303e2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.162977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 148/298] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:23.167837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.168391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.169140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.188147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 151/299] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:23.192746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:23.194154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:23.262967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 149/300] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:23.406562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.454297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:23.468235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.507804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:23.515203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08850c-b77f-40fa-9820-12ec6b0c0968 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.552535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.553447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.553743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.554021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.564497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:23.569329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:23.570428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:23.571373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:23.576103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 152/301] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:23.576103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.582380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e513863-ea04-4020-a1ec-94efdfea46e1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.615987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.616662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.616941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.617215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.618309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:23.619767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:23.624093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 150/302] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:23.624093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.686191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903baf4b-285b-4432-896f-3749b5f6dfb5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.693445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:23.720530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.721685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.721963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.722240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.730405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690024ae-c9af-4f52-af3d-a09fda842022 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.732316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:23.733532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:23.737301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:23.738192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 153/303] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:23.742776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.766516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.767055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.767848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.768148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.768810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:23.769109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:23.770461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d4466-77dd-4481-be8b-4bdee7219467 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:23.778301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 151/304] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:23.779444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dee24-7d77-4a0a-8b58-34fbf49bab24 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.779725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dee24-7d77-4a0a-8b58-34fbf49bab24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.780000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dee24-7d77-4a0a-8b58-34fbf49bab24 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.781210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 152/305] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:23.781994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dee24-7d77-4a0a-8b58-34fbf49bab24 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.838813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733036f9-ae6a-472d-8541-4ad8901ee98d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.871426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.872024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.872338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.872612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] PATH_INFO: `/v3/groups` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.873223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:23.874958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:23.880111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dee24-7d77-4a0a-8b58-34fbf49bab24 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:23.889904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 154/306] 10.222.0.73 () {60 vars in 1134 bytes} [Thu Aug 18 16:27:23 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:23.904320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:23.922333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:23.933881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:23.934607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.934957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.935318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.936081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:23.936659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:23.938233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a811b97-3d69-4b37-b045-c9843a432560 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:23.952232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 153/307] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:23.955543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66733-b340-4397-b330-62775c861caf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:23.956089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66733-b340-4397-b330-62775c861caf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:23.956351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da66733-b340-4397-b330-62775c861caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:23.975913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9da66733-b340-4397-b330-62775c861caf None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:23.977185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9da66733-b340-4397-b330-62775c861caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:24.002959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:24.010275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66319f7d-dd54-4dd8-8d32-a358fb919ff7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.053823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.054755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.054755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.054941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] PATH_INFO: `/v3/users/2db3518966a248b1a0e14db2dd83456c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.055130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 154/308] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:24.056002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66733-b340-4397-b330-62775c861caf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.076917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] RBAC: Authorizing `identity:get_user(user_id=2db3518966a248b1a0e14db2dd83456c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.078557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.081876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 155/309] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:23 2022] GET /identity/v3/users/2db3518966a248b1a0e14db2dd83456c => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:24.087749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.172416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da66733-b340-4397-b330-62775c861caf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.209055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:24.210225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.211227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.211759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.212288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] PATH_INFO: `/v3/users/f18adaf9d9b447e6941f3f85e85494cc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.213626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] RBAC: Authorizing `identity:get_user(user_id=f18adaf9d9b447e6941f3f85e85494cc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.215257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.217088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 155/310] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/users/f18adaf9d9b447e6941f3f85e85494cc => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:24.224034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.233801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc756bff-60b7-412b-a1a7-5c10080c509a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.254282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:24.282028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.282639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.283440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.283725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.284483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, user.id=2db3518966a248b1a0e14db2dd83456c, scope.system=all) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:24.284793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.286789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.298623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 156/311] 10.222.0.73 () {56 vars in 1308 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/role_assignments?user.id=2db3518966a248b1a0e14db2dd83456c&scope.system=all&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:24.328384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.343437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b7f0-c268-4af4-ac31-9819d01aa948 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.383653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.384368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.384643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.384918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] PATH_INFO: `/v3/system/users/f18adaf9d9b447e6941f3f85e85494cc/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.386372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f18adaf9d9b447e6941f3f85e85494cc, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.387774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.399530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 156/312] 10.222.0.73 () {58 vars in 1334 bytes} [Thu Aug 18 16:27:24 2022] PUT /identity/v3/system/users/f18adaf9d9b447e6941f3f85e85494cc/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:24.472771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d093c-6517-4804-9caf-cf28d1e8b14a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.510796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.511684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.512245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.512684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.525324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:24.531241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:24.532398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:24.533963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:24.536288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 157/313] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:24.542385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.640772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:24.651297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04215e-5f10-4a91-9c83-b2dc1b338af0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.686127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.686735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.687015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.687285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.687934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:24.688262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.689655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.702351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 157/314] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:24.703700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.715997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:24.811972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acdf2-1250-4c2e-9684-7fb2937a1879 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.847028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:24.847671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:24.847955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:24.848263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] PATH_INFO: `/v3/users/60e202cd6def4deca7316e2e427cdbaf` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:24.849392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] RBAC: Authorizing `identity:get_user(user_id=60e202cd6def4deca7316e2e427cdbaf)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:24.850855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:24.852774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 158/315] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/users/60e202cd6def4deca7316e2e427cdbaf => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:24.858721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:24.964037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a0963-1ccb-451e-b11b-bc514567a368 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:24.999521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:25.000163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:25.000448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:25.000722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:25.028491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:25.071623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:25.073097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:25.176264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 158/316] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:25.177552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:25.259574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:25.284111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b10b9-b366-476e-a80b-4de1b75fe52b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:25.318196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:25.318890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:25.319171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:25.319442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:25.320578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:25.322031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593d6bc-0341-4c42-989f-78f8fc6d7abb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:25.328232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 159/317] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:25 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:25.330639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:25.385272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:25.439157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e31af-08a3-4887-bfb0-987b6c415769 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:25.478138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:25.478753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:25.479034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:25.479306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:25.480101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, scope.project.id=7de78f52ec9a4de8b0175065fe065864, user.id=60e202cd6def4deca7316e2e427cdbaf) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:25.480418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:25.481897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd48-d3c4-44d4-be8b-a1d276db36c6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:25.492192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 159/318] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:25 2022] GET /identity/v3/role_assignments?user.id=60e202cd6def4deca7316e2e427cdbaf&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:25.880934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec6b7-5bf9-4386-bc90-e17cf45ed71e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:25.881318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec6b7-5bf9-4386-bc90-e17cf45ed71e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:25.881720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cec6b7-5bf9-4386-bc90-e17cf45ed71e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:25.883653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 160/319] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:25.888638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a6a9-40e8-4b14-8f2e-5ad0e5ec3cf3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:25.888931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a6a9-40e8-4b14-8f2e-5ad0e5ec3cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:25.889208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a6a9-40e8-4b14-8f2e-5ad0e5ec3cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:25.907942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f4f0a6a9-40e8-4b14-8f2e-5ad0e5ec3cf3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:25.909149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4f0a6a9-40e8-4b14-8f2e-5ad0e5ec3cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:25.980171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 160/320] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:26.248708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cec6b7-5bf9-4386-bc90-e17cf45ed71e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:26.286813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78eef3-150b-48ed-9fe6-87c49844425f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.287326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78eef3-150b-48ed-9fe6-87c49844425f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.287402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78eef3-150b-48ed-9fe6-87c49844425f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.288727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 161/321] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:26.293555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d5bd-da39-4eae-bbfb-7c1ed4e95a1a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.293876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d5bd-da39-4eae-bbfb-7c1ed4e95a1a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.294105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6d5bd-da39-4eae-bbfb-7c1ed4e95a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.312477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-65d6d5bd-da39-4eae-bbfb-7c1ed4e95a1a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:26.314081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-65d6d5bd-da39-4eae-bbfb-7c1ed4e95a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:26.356149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cec6b7-5bf9-4386-bc90-e17cf45ed71e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:26.358627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:26.383832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 162/322] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:26.385165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bd97-a68e-47e8-acd5-cff87152e92c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.385478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bd97-a68e-47e8-acd5-cff87152e92c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.385734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bd97-a68e-47e8-acd5-cff87152e92c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.386960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 163/323] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:26.390693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:26.391532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.391989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.392286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.392579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.392878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.392978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.394229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:26.395912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:26.397889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 161/324] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:26.403037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:26.411593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:26.412815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:26.420748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:26.483907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 164/325] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:26.514871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336a0d-acec-4794-bd12-ee5890c75010 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:26.549677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:26.550642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.551122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.551655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] PATH_INFO: `/v3/groups` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.552464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:26.554080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:26.570253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 162/326] 10.222.0.73 () {60 vars in 1134 bytes} [Thu Aug 18 16:27:26 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:27:26.653094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:26.753005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:26.761991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6afb5-4964-417b-a71a-8a9d31f96a78 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:26.770912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:26.800372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:26.801485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.801485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.801667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.815186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:26.821212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:26.822105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:26.822937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:26.825258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 165/327] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:26.832185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:26.845368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:26.886807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd9da6-c3d7-4c60-b16b-02a4e087dd27 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:26.935741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:26.936693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:26.937074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:26.937360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:26.950995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:26.956451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:26.957547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:26.958699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 163/328] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:26.967347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070121f3-61ac-42b8-9f6c-139172db8792 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:26.969318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:27.012918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.014462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.014918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.015367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.016233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:27.016910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.019870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.030974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 166/329] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:27.039410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:27.071797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:27.102659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1a3de-06df-4bff-ac43-a1e4ebe0ea97 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:27.145799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:27.153665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.154520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.154942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.155357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.156221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:27.156665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.158832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.168298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 164/330] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:27.174797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:27.179226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9e1cc-1566-4e3b-94de-f6ba340401c0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:27.226906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.227890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.228401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.228898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] PATH_INFO: `/v3/users/2db3518966a248b1a0e14db2dd83456c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.230283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=2db3518966a248b1a0e14db2dd83456c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.231941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.234163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 167/331] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:27 2022] GET /identity/v3/users/2db3518966a248b1a0e14db2dd83456c => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:27.240482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:27.308466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc61cb-41ec-481a-b98b-fb8f0b3f20df None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:27.355519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.356257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.356517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.356793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] PATH_INFO: `/v3/users/f18adaf9d9b447e6941f3f85e85494cc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.357949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f18adaf9d9b447e6941f3f85e85494cc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.359420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.363723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 165/332] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:27 2022] GET /identity/v3/users/f18adaf9d9b447e6941f3f85e85494cc => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:27.369027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:27.369485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:27.377836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8e66-fe2c-4a8d-8732-405d6ffc9ee5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:27.420915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.422004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.422288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.422561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] PATH_INFO: `/v3/system/users/2db3518966a248b1a0e14db2dd83456c/roles/9a09dc5ab5624c2c946940bbb22140a2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.424444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2db3518966a248b1a0e14db2dd83456c, role_id=9a09dc5ab5624c2c946940bbb22140a2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.426432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30eec1-7a5e-41dc-900e-7fe3ffeaad3c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.436397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 168/333] 10.222.0.73 () {58 vars in 1334 bytes} [Thu Aug 18 16:27:27 2022] PUT /identity/v3/system/users/2db3518966a248b1a0e14db2dd83456c/roles/9a09dc5ab5624c2c946940bbb22140a2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:27.450779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:27.498719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575bad9-8e2a-42f6-9fc8-e38f9263e7e4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:27.539769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:27.540405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:27.540683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:27.540954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:27.541753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] RBAC: Adding query filter params (role.id=3524ec8100184d48956522845b1fbebe, user.id=f18adaf9d9b447e6941f3f85e85494cc, scope.system=all) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:27.542065 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:27.543573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f109d8b-736d-4c63-b1ec-572f31639f05 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:27.557699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 166/334] 10.222.0.73 () {56 vars in 1308 bytes} [Thu Aug 18 16:27:27 2022] GET /identity/v3/role_assignments?user.id=f18adaf9d9b447e6941f3f85e85494cc&scope.system=all&role.id=3524ec8100184d48956522845b1fbebe => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:28.750044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd131197-db51-4f06-a117-c49c26fe87fb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:28.750533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd131197-db51-4f06-a117-c49c26fe87fb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:28.750644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd131197-db51-4f06-a117-c49c26fe87fb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:28.752820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 169/335] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:28.758905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:28.759756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:28.760273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:28.778981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:28.780519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:28.856181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 167/336] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:29.131357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd131197-db51-4f06-a117-c49c26fe87fb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:29.252789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd131197-db51-4f06-a117-c49c26fe87fb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:29.287767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:29.288452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.288732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.289005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.299575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:29.304832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:29.305764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:29.306562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 170/337] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:29.313098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:29.375769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:29.437120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a693eaa-303e-40bc-983a-987b353c4ea2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:29.473487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:29.474108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.474389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.474666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.475466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:29.475781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:29.477294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb43e0-7df4-4883-9e2a-f8985552c1d3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:29.486408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 168/338] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:29.491941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:29.520802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:29.561223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bb16-a7d0-45e7-8a3c-2908a9831a83 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.561540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bb16-a7d0-45e7-8a3c-2908a9831a83 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.561772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bb16-a7d0-45e7-8a3c-2908a9831a83 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.563301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 169/339] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:29.569422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3fee-f56d-4023-b49b-bf76e7d95454 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.569961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3fee-f56d-4023-b49b-bf76e7d95454 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.576656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da3fee-f56d-4023-b49b-bf76e7d95454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.604807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725b27-5ac6-42e8-9038-b84a57f48478 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:29.621141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a6da3fee-f56d-4023-b49b-bf76e7d95454 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:29.622661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a6da3fee-f56d-4023-b49b-bf76e7d95454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:29.644278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:29.644947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.645232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.645521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.738793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:29.740286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:29.765207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:29.818703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 170/340] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:29.820110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca6f7-845f-435e-bc51-fe10cf9d98d0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.820402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca6f7-845f-435e-bc51-fe10cf9d98d0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.820676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca6f7-845f-435e-bc51-fe10cf9d98d0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.825170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 171/341] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:29.829569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:29.829884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:29.830158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:29.849290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 171/342] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:29.855055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:29.858409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:29.859646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:29.898212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:29.949749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 172/343] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:29.971525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa74e5-88af-4dcd-a813-491903d251e3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:29.997552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:30.011991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.012718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.013002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.013275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.014428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:30.015871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:30.017858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 172/344] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:29 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:30.023486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.143438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6509ebd-5117-46b1-a8ac-eda1b0ad434d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.179435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.180415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.180872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.181357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.188400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:30.190639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:30.192453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 173/345] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:30.198490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.275315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.321909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:30.346523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe403a8-3e93-4b44-a85b-6bb84378b3f3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.405908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa36b4-e338-4688-83cb-757d5031f58a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.436795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.437444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.437706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.437982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.438713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=badda7d5a32546ec8b95ecc67718f53f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:30.439076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:30.440554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:30.445542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.446424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 173/346] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=3524ec8100184d48956522845b1fbebe => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:30.446536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.446979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.447225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.447731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.470674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:30.476312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:30.477243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:30.478041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:30.486420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 174/347] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:30.510083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.537364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:30.596194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366b1b7-327b-478c-9c89-311109ddc279 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.639900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.640584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.640864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.641136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.668074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:30.674152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:30.675214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:30.676046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 174/348] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:30.682210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.711991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:30.725878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5df0-2dad-4717-a42a-ee821f5911b3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.778977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.780130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.780613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.781086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.782081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:30.782587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:30.785401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22797-c71a-4f07-9ca0-d91728b38e6b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:30.795437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 175/349] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:30.797156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee2e1-42a8-4ec2-9f09-845f5f337b1a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.797669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee2e1-42a8-4ec2-9f09-845f5f337b1a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.798177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee2e1-42a8-4ec2-9f09-845f5f337b1a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.800541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 176/350] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:30.801461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee2e1-42a8-4ec2-9f09-845f5f337b1a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:30.832546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f29df-c896-4cd8-9eb9-9e71bd07e58e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.846212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:30.871702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.872846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.873125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.873403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.874055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:30.874621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:30.875989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e631b8-d41e-4312-af9d-4c7fe7e90da3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:30.884988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 175/351] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:30.886318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.886601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.886881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:30.917088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:30.918602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:30.936401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee2e1-42a8-4ec2-9f09-845f5f337b1a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:30.976432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:30.977419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:30.977982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:30.978543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.010202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:31.033775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 176/352] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:31.041352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.071208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:31.073238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd50869-df05-40c8-b2e9-7e2dfc5f5602 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:31.222643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 177/353] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:31.224173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3818b-b9c5-4ab7-b76a-665204e64580 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.224563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3818b-b9c5-4ab7-b76a-665204e64580 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.225002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3818b-b9c5-4ab7-b76a-665204e64580 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.232992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 178/354] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:31.234398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3818b-b9c5-4ab7-b76a-665204e64580 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.266233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f206eb-295d-440c-8239-c7537e3a662b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:31.270990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:31.310885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:31.344878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:31.345467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.345750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.346022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.372296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3818b-b9c5-4ab7-b76a-665204e64580 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:31.411772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:31.412874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.413410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.413912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.415372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:31.417082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91b451-e478-452c-bcb8-2aaf732d5d25 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:31.419410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 179/355] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:31.421503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.421987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.422477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.443966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:31.445753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:31.484295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:31.485758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:31.581614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 180/356] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:31.582852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.659392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 177/357] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:31.660330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.663458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:31.680704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:31.745198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6c877-8a07-478a-952d-39470c2d2e79 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:31.807118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:31.807664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145ecf-da89-4d87-a1fc-2f2150cf0e40 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:31.807783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.808083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.808374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.809750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:31.812435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:31.814348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 181/358] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:31.820874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.860282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:31.862286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.868103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.868103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.896947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2defc4ce-2ae4-4ae1-8ab4-6694a92d4085 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:31.903005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:31.903876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:27:31.904769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:31.907077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 178/359] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:31.909382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c681e-6055-4b42-9d1b-ce7884059d53 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:31.909943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c681e-6055-4b42-9d1b-ce7884059d53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:31.910428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c681e-6055-4b42-9d1b-ce7884059d53 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:31.912233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 179/360] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:31.913138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c681e-6055-4b42-9d1b-ce7884059d53 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:31.961091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787d0fb-d6f5-4d1c-ab01-a00fe024bd2b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:31.996517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.001944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.016167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.017993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.018434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.018708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.020274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.022175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.025535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 182/361] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.026343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.049092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c681e-6055-4b42-9d1b-ce7884059d53 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.097815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.098804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.098804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.098974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.099677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=7de78f52ec9a4de8b0175065fe065864) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:32.099984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.101559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ce34-a04a-412a-bc4b-e40d6a7467bf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.108077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 180/362] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:31 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=3524ec8100184d48956522845b1fbebe => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.109218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.109503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.109786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.129545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:32.130769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:32.162711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccdcac-3ce6-4d33-b0ce-ebd1c14142ec None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.209897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 181/363] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:32.210554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.210773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.211564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.211849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.212208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.212893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:32.213439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.215783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.226161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 183/364] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.227039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.306225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.322475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.368260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a049-ea1c-4dc3-abd0-09cd710af8ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.373356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f85e-4e2a-4152-bdae-1efe9fd87845 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.406302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.407048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.407330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.407641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.420096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:32.425017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:32.425892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:32.426727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 182/365] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:32.427848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.453340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.453995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.454286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.454608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.455728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.457190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.459277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 184/366] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.460037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.579167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c56d-7707-4cf4-8d0d-30db8fd57b98 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.603280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adfb5e-c0dc-4d6c-baed-99986034347e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.606809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.620961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.622030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.622511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.623019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] PATH_INFO: `/v3/users/2db3518966a248b1a0e14db2dd83456c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.624739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] RBAC: Authorizing `identity:get_user(user_id=2db3518966a248b1a0e14db2dd83456c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.626494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.629195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 183/367] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/users/2db3518966a248b1a0e14db2dd83456c => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.630393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.636280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.659664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731625-4b35-439b-8174-31152906522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.660821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731625-4b35-439b-8174-31152906522e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.661322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731625-4b35-439b-8174-31152906522e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.661791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731625-4b35-439b-8174-31152906522e None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.663753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731625-4b35-439b-8174-31152906522e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:32.664438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731625-4b35-439b-8174-31152906522e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.666637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731625-4b35-439b-8174-31152906522e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.675944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 185/368] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.677122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731625-4b35-439b-8174-31152906522e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.755443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3f4a5-8347-4dc3-b9a9-4c9afd858688 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.805726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.806819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.807297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.807764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.808759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=badda7d5a32546ec8b95ecc67718f53f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:32.811015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731625-4b35-439b-8174-31152906522e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:32.812452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:32.814988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:32.824144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 184/369] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:32.825355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.881833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:32.884230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:32.884851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:32.885326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:32.900358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:32.908075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:32.909072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:32.909913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:32.912966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 186/370] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:32.914293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:32.979319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:32.980766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.054697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1c7a-f2f5-4d71-96d6-64d67e277e7e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.089121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b90c-ac71-4d0d-8d5d-6e6d96ecf391 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.091447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.092085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.092370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.092647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.094250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] RBAC: Adding query filter params (role.id=9a09dc5ab5624c2c946940bbb22140a2, user.id=2db3518966a248b1a0e14db2dd83456c, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:33.094566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.096592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.110063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 185/371] 10.222.0.73 () {56 vars in 1308 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/role_assignments?user.id=2db3518966a248b1a0e14db2dd83456c&scope.system=all&role.id=9a09dc5ab5624c2c946940bbb22140a2 => generated 510 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:33.111145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.220871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.221785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.222068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.222341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.225654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e2649-e473-4516-a7c3-2af2a93d2393 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.236580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.265943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.266638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.266926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.267827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.268560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:33.268875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.270566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.280531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 186/372] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:33.289029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.373177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.374951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b6cfc-5d12-4332-87c0-5b9f3737682c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.410062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75b066-bfa5-4802-a156-73e52122a1a8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.460819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.461507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.461790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.462118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.471100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.515291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.550151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.551632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.552715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 187/373] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:33.554045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b991-b8a3-475d-95ca-f8d4b1a4deac None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.554613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b991-b8a3-475d-95ca-f8d4b1a4deac None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.554888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b991-b8a3-475d-95ca-f8d4b1a4deac None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.557114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 188/374] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:33.562436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.562724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.563636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.590253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:33.591873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:33.666038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 187/375] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:33.667133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.675901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 189/376] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:33.676788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.738604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.760833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:33.772127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62afdfb-c3fa-4a18-8a49-991d96bbdf58 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.791523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53247c1a-f015-4f69-984d-4011fbbcc2c1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.810245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.810888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.811166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.811438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.812617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.814595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.816321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 188/377] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:33.821819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.829015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.829717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.830000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.830273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] PATH_INFO: `/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.831498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] RBAC: Authorizing `identity:get_project(project_id=9f85ef77f8be4f4d9ae6c447129ea73f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.832969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.835093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 190/378] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:33.840502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.934977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13352a23-35a3-4b63-828c-a8fb0c8f9530 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.961809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82300fd-e062-4c12-8564-c22a5e0f50eb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:33.971873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:33.972555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:33.972834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:33.973152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:33.974299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:33.975758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:33.977337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 189/379] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:33.983199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:33.993206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:34.000090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.000691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.000980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.001255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] PATH_INFO: `/v3/groups/cbf89e89f8b44da680d056ea285438e5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.006467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf89e89f8b44da680d056ea285438e5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:34.007998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:34.009967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 191/380] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/groups/cbf89e89f8b44da680d056ea285438e5 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:34.015389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:34.028270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:34.103126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21e0a4-4beb-4fc1-a531-cdfde5f3b30e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:34.144550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.145169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.145445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.145716 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.146444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=7de78f52ec9a4de8b0175065fe065864) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:34.146751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:34.148228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:34.154818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50b8c-77e7-4da9-a583-c973fcfe5600 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:34.156175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 190/381] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:33 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:34.195399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.196030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.196360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.196639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.197380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] RBAC: Adding query filter params (group.id=cbf89e89f8b44da680d056ea285438e5, role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=9f85ef77f8be4f4d9ae6c447129ea73f) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:34.197692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:34.199164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:34.206647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 192/382] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:34 2022] GET /identity/v3/role_assignments?group.id=cbf89e89f8b44da680d056ea285438e5&scope.project.id=9f85ef77f8be4f4d9ae6c447129ea73f&role.id=f6300a9e15d04a299f9847938352da84 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:34.245975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:34.354841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:34.387762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677ee0-397a-4932-b9f9-1da64408a592 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:34.424494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.425129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.425408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.425678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.436370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:34.442273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:34.444244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:34.445045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 191/383] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:34.449226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:34.550377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:34.588380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63039a5-36c0-40b4-b56f-9dcb047178ef None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:34.627436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.628012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.628320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.628590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.629301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:34.629603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:34.630985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:34.641584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 193/384] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:34.646711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:34.784286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bffc0d-3baf-4438-9eca-01e591a5860b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:34.823253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:34.829268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:34.830475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.830749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.831016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.833873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:34.835334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8c190-3a91-4ed7-94a8-d1da48ce3c50 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:34.837589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 192/385] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:34 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:34.842452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:34.909449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98933-f359-40d7-8308-36d885d52080 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.909773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98933-f359-40d7-8308-36d885d52080 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.909987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa98933-f359-40d7-8308-36d885d52080 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.911430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 193/386] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:34.917154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c470-4204-44eb-97f3-62588c825ada None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:34.917154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c470-4204-44eb-97f3-62588c825ada None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:34.917154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c470-4204-44eb-97f3-62588c825ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:34.936930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4430c470-4204-44eb-97f3-62588c825ada None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:34.938497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4430c470-4204-44eb-97f3-62588c825ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:34.987196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f32fe-cfea-4f89-8f4b-4e2bd770e7b1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:35.044444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:35.054977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:35.057487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.057980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.058460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.061105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:35.063691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:35.067298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 194/387] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:34 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:35.069954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 194/388] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:35.077036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:35.185567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409ac62-4a64-4e30-80ff-5b7035290e71 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:35.229529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:35.230562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.231044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.231517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/groups/286aba5d35b34cea9fd84c0964d99dff/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.233729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, group_id=286aba5d35b34cea9fd84c0964d99dff, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:35.235368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26a35d-d97b-4d11-b128-9f196d6edf22 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:35.250377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 195/389] 10.222.0.73 () {58 vars in 1442 bytes} [Thu Aug 18 16:27:35 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/groups/286aba5d35b34cea9fd84c0964d99dff/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:35.343960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400ce7-6417-41c1-81f7-9a1689887fdd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.344637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400ce7-6417-41c1-81f7-9a1689887fdd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.345184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18400ce7-6417-41c1-81f7-9a1689887fdd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.347002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 195/390] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:35.352889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.353487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.353961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.372921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:35.374730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:35.437059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:35.450651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 196/391] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:35.491147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400ce7-6417-41c1-81f7-9a1689887fdd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:35.615879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18400ce7-6417-41c1-81f7-9a1689887fdd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:35.648132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:35.657800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:35.658742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.659238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.659707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.671005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:35.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:35.677844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:35.678640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:35.681454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 196/392] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:35.687355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:35.777932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:35.811806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604662be-5bfe-4eba-ac7a-ced1f0fc009f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:35.856827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:35.857435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.857717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.857990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.858652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:35.858957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:35.860371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:35.878561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 197/393] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:35.884085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:35.890465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c6ad-a719-49cb-99bb-f98a5af6441a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:35.927375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:35.928419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:35.928904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:35.929373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:35.943735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:35.949180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:35.950070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:35.950880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 197/394] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:35.956271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:35.959140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.011904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318310a-f263-4855-9258-abb70dec1e70 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.030993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:36.052125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.052805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.053044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.053322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.054455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.055895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.059523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 198/395] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:35 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:36.069130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.098150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06f62d-fc1b-4b8a-b1fe-3c38b7db292e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.140403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.141025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.141305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.141583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.142351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:36.142757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.144231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.160546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 198/396] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:36.166277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.219592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c8b98-0f08-4a08-ad80-5504863bf184 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.258967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:36.273517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.274163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.274448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.274734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.277946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.279409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.281458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 199/397] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:36 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:36.292976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.341136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386b9b-96a6-44e3-982f-8e561cd328f0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.364427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:36.396629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.397270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.397724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.397997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.401153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.402714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.404339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 199/398] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:36 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:36.410570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.484270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3500-a609-408b-add7-e6626911e068 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.519385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40dd0c-ef09-4a4c-af86-f0d7d1a5eb22 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.549752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.550753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.551253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.551715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/groups/286aba5d35b34cea9fd84c0964d99dff/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.554532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, group_id=286aba5d35b34cea9fd84c0964d99dff, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.556688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f1241-b2dc-49b4-a464-ff12baae19dd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.557489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.558349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.558831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.561504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.563619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.565576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.568397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 200/399] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:36 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:36.575169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:36.582723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 200/400] 10.222.0.73 () {58 vars in 1442 bytes} [Thu Aug 18 16:27:36 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/groups/286aba5d35b34cea9fd84c0964d99dff/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:36.640157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:36.711117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c778368-0565-4a9f-b863-88763a576772 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:36.759747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:36.760369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.760651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.760922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f/groups/286aba5d35b34cea9fd84c0964d99dff/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.766045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=badda7d5a32546ec8b95ecc67718f53f, group_id=286aba5d35b34cea9fd84c0964d99dff, role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:36.768090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dafae2-d9c3-469b-a638-4cbceb123cc5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:36.790288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 201/401] 10.222.0.73 () {58 vars in 1442 bytes} [Thu Aug 18 16:27:36 2022] PUT /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f/groups/286aba5d35b34cea9fd84c0964d99dff/roles/aea8cb3d868e426794cd392f72d51d71 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:36.793189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed025-75d6-4996-be3c-b607419c3739 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.793476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed025-75d6-4996-be3c-b607419c3739 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.793820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed025-75d6-4996-be3c-b607419c3739 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.795536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 201/402] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:36.801952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d737ba-09e8-4ecd-9962-a4d5dcd633b5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:36.802283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d737ba-09e8-4ecd-9962-a4d5dcd633b5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:36.802560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d737ba-09e8-4ecd-9962-a4d5dcd633b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:36.825995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-62d737ba-09e8-4ecd-9962-a4d5dcd633b5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:36.827247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62d737ba-09e8-4ecd-9962-a4d5dcd633b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:36.902567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 202/403] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:37.003933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272255c-b881-4c15-849f-28f4cb7d14a2 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.004260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272255c-b881-4c15-849f-28f4cb7d14a2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.004516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272255c-b881-4c15-849f-28f4cb7d14a2 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.006017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 202/404] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:37.011410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.011705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.011886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.034367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:37.035584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:37.071458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:37.116426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 203/405] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:37.191608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272255c-b881-4c15-849f-28f4cb7d14a2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.244951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:37.302311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272255c-b881-4c15-849f-28f4cb7d14a2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:37.340863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:37.341499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.341778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.342046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.353457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:37.358383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:37.359281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:37.360247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 203/406] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:37.365307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.497858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12558-4674-4d1d-91b2-bcfc8fedc078 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:37.529843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.550432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:37.551390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.551884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.552421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.553284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:37.553984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:37.557034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:37.574185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 204/407] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:37.581710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.632956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:37.723938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f62f-80e3-4364-baab-1668a8e1f944 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:37.762317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:37.762959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.763239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.763511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] PATH_INFO: `/v3/groups/cbf89e89f8b44da680d056ea285438e5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.763826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832047f-3ca6-4d81-a7e3-a7b2639bbc2d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:37.764639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf89e89f8b44da680d056ea285438e5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:37.768640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:37.768640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 205/408] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/groups/cbf89e89f8b44da680d056ea285438e5 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:37.774052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.786619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:37.833709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:37.834253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:37.834532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:37.834805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:37.861485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:37.866258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:37.867156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:37.867964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:37.874174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 204/409] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:37.875292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:37.956426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:37.963677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06ff1-2621-4843-8f8d-ff140e48a6d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.030883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664347ec-9522-40da-b989-8d673c72239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.031534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664347ec-9522-40da-b989-8d673c72239d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.031815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664347ec-9522-40da-b989-8d673c72239d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.032099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664347ec-9522-40da-b989-8d673c72239d None admin] PATH_INFO: `/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.033609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664347ec-9522-40da-b989-8d673c72239d None admin] RBAC: Authorizing `identity:get_project(project_id=9f85ef77f8be4f4d9ae6c447129ea73f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.035037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664347ec-9522-40da-b989-8d673c72239d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.036684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 206/410] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f => generated 344 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:38.046022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664347ec-9522-40da-b989-8d673c72239d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:38.075046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6fe26-465c-45ab-b3f5-4f6e21fac345 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.112545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.113084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.113363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.113635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.114311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:38.114615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.116045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eac57-d874-486f-a0c0-d37e96340ca7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.125706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 205/411] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:38.127292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a516-a00e-403e-95ac-b7b361abd220 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.127577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a516-a00e-403e-95ac-b7b361abd220 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.127852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a516-a00e-403e-95ac-b7b361abd220 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.129199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 206/412] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:38.134055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2a516-a00e-403e-95ac-b7b361abd220 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:38.168458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:38.168639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664347ec-9522-40da-b989-8d673c72239d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.203400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.204145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.205051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.205329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] PATH_INFO: `/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f/groups/cbf89e89f8b44da680d056ea285438e5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.207305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] RBAC: Authorizing `identity:create_grant(project_id=9f85ef77f8be4f4d9ae6c447129ea73f, group_id=cbf89e89f8b44da680d056ea285438e5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.208776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607b8ae-6aff-4187-9c84-d7def05525eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.223004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 207/413] 10.222.0.73 () {58 vars in 1442 bytes} [Thu Aug 18 16:27:38 2022] PUT /identity/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f/groups/cbf89e89f8b44da680d056ea285438e5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:38.224299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.224647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.224971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.256649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:38.257940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:38.292212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:38.299605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2a516-a00e-403e-95ac-b7b361abd220 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.370507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.371113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.371440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.371716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.373462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.376760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.380663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 207/414] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:38 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:38.386425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:38.391602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 208/415] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:38.506973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:38.515866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31fe3-ce81-479f-87c4-f77d017d6b3d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.560199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.560841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.561124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.561401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.562541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.564538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.566485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 208/416] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:38 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:38.572070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:38.705799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa195e5-7232-49fa-9872-6c4e7225001e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.741611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.742292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.742573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.742848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864/groups/286aba5d35b34cea9fd84c0964d99dff/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.745007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de78f52ec9a4de8b0175065fe065864, group_id=286aba5d35b34cea9fd84c0964d99dff, role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:38.746445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:38.764849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 209/417] 10.222.0.73 () {58 vars in 1442 bytes} [Thu Aug 18 16:27:38 2022] PUT /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864/groups/286aba5d35b34cea9fd84c0964d99dff/roles/aea8cb3d868e426794cd392f72d51d71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:27:38.790614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:38.926709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6733f88-918f-463e-bca8-fe3f48fcd298 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:38.974155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:38.975126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:38.975623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:38.976123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:38.987465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-124d94ec-7990-4f23-94b8-ac4769539b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:38.992961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:38.993839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:38.994632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:38.996887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 209/418] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:39.003609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.028999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.113860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b549b-e92f-4ba5-8402-7fd0509ce419 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:39.117450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263b2b-26cc-48d1-b7df-6cc1cd5224cb None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.117450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263b2b-26cc-48d1-b7df-6cc1cd5224cb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.117679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263b2b-26cc-48d1-b7df-6cc1cd5224cb None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.119248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 210/419] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:39.124921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce9b-76b8-4f92-a9a0-85c4bac9bc58 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.125204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce9b-76b8-4f92-a9a0-85c4bac9bc58 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.125477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ce9b-76b8-4f92-a9a0-85c4bac9bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.163055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:39.164133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.164616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.165084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.165940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:39.167057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4171ce9b-76b8-4f92-a9a0-85c4bac9bc58 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:39.167566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:39.169289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4171ce9b-76b8-4f92-a9a0-85c4bac9bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:39.170595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:39.191270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 210/420] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:39.196880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.228575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.304263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 211/421] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:39.305710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e746ad-dcf3-41ae-b367-6a50b2423269 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.306043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e746ad-dcf3-41ae-b367-6a50b2423269 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.306347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e746ad-dcf3-41ae-b367-6a50b2423269 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.307859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 212/422] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:39.313295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.313579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.314391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.320210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.343403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:39.344589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:39.368123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8ff8-c5bf-4934-8594-9ad76ea2b441 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:39.429391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:39.430386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.430992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.431452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.472823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 213/423] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:39.505356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:39.507082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:39.585809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.609927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 211/424] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:39.615386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.628186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.776114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.804566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169b3d1-bed9-4853-b712-6acbabe0e3a3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:39.812421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf87ca-b252-4e74-be2b-0e4a0236b4b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:39.850008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:39.850639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.850920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.851192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.852328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:39.853758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:39.855744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 214/425] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:39.856539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.865169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:39.865815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:39.866096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:39.866365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:39.881206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:39.888083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:39.889201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:39.890090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 212/426] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:39.890789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:39.938227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:39.988363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93ef90-4409-40f2-b802-e09662e4146f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.020725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714253d-7f63-492f-84cb-e28de50ab178 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.024430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.025262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.025701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.026182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.041543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:40.049194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:40.050203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:40.051071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 215/427] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:40.051771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.067565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.068611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.069106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.069579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.070623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.071865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.073639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.075785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 213/428] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:39 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.076996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.171712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5269b-82b2-41e4-a062-f0156bebb742 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.192273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7316085-46dc-4e04-877a-a8f900b4fe7c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.194657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.210129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.210792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.211071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.211483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.212194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] RBAC: Adding query filter params (name=member) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:40.212595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.214099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.224545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 216/429] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.225540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.231689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.232333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.232609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.232873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.233537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:40.233832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.235320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.245110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 214/430] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.246014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.309322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.334767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeecf5-7364-42de-a568-408d44c0f66c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.352714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a346-93ce-4a1e-a6df-099c7a679a74 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.370578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.371290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.371575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.371929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.372677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=badda7d5a32546ec8b95ecc67718f53f) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:40.372986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.374718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.381148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 217/431] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=3524ec8100184d48956522845b1fbebe => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.381925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.398415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.399046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.399325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.399691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.443857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.484837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.487010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef311530-db77-4b79-ba9a-ca3ee8ccdc3f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.523044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab6df-69a9-41a5-9d0b-32040448b1e9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.562244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.562777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.563056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.563327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.575081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.619234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 215/432] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:40.621027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a49a-3e90-4cb3-8e8a-6be565751610 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.621576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a49a-3e90-4cb3-8e8a-6be565751610 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.621858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27a49a-3e90-4cb3-8e8a-6be565751610 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.625318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 216/433] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:40.626073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27a49a-3e90-4cb3-8e8a-6be565751610 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.651703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.653234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431d182-310d-4d8c-bfc1-4cdd3b24622d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.713901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.759304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27a49a-3e90-4cb3-8e8a-6be565751610 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.788271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 218/434] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:40.789976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.790473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.790947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.801110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.801762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.802044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.802313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.803458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.804927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.806864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 217/435] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.807671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.812961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:40.814131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:40.851301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:40.891241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 219/436] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:40.892895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.925839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4e0c-756f-4168-ac32-0dfb48b41c80 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:40.967951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:40.969073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:40.969535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:40.970594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] PATH_INFO: `/v3/projects/badda7d5a32546ec8b95ecc67718f53f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:40.972072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] RBAC: Authorizing `identity:get_project(project_id=badda7d5a32546ec8b95ecc67718f53f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:40.973868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:40.976241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 218/437] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/projects/badda7d5a32546ec8b95ecc67718f53f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:40.981349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:40.983984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.024703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f50df-8c26-482f-badd-2411eefe8091 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.063149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.064141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.064647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.065093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.066397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.068093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.070611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 220/438] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:41.077886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.105887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7d26-0df6-4b5e-8bc8-672aa5ca30b0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.125583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.141737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.142990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.143268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.143536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.144651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.146107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7773-f5fc-46f4-8c44-01a829b63eed None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.147641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 219/439] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:40 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:41.148746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f851-ac8b-4fe4-a783-e3f7e103a67e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.149023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f851-ac8b-4fe4-a783-e3f7e103a67e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.149292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f851-ac8b-4fe4-a783-e3f7e103a67e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.150614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 220/440] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:41.155062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f851-ac8b-4fe4-a783-e3f7e103a67e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.194756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063190cb-7b22-43b5-a453-a50eafa9be38 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.226385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.228665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.229262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.229539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.229811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.230523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=3524ec8100184d48956522845b1fbebe, scope.project.id=7de78f52ec9a4de8b0175065fe065864) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:41.230830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.232494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3409bf-e715-4bd9-b646-a6196de5678f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.238046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 221/441] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=3524ec8100184d48956522845b1fbebe => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:41.239178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.239460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.239730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.260307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:41.261542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:41.269863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f851-ac8b-4fe4-a783-e3f7e103a67e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.308529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.309151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.309428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.309696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.310428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=badda7d5a32546ec8b95ecc67718f53f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:41.310747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.312210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.328182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 221/442] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=badda7d5a32546ec8b95ecc67718f53f&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:41.328182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.349940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 222/443] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:41.453008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51492a-2443-4f21-818b-851ff8d73802 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.490960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.491603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.491887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.492189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.494086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.505388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:41.510683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:41.511599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:41.512447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 222/444] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:41.517663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.549608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.620437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.620748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57998d-38c5-478a-b50b-b33648eb5c2b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.662808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.663424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.663700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.663976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.664678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:41.664987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.666365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.676234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 223/445] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:41.681774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.738744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533341-4f86-4dc8-a787-49a43a3cec56 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.781416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.782284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.783293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.783566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.795285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:41.796028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:41.800248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:41.801140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:41.801920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 223/446] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:41.810854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f7078-dc6c-46c7-a274-4b6b4d8965c1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.811718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:41.848909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.849520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.849799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.850072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.880737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:41.919489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.921036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.923786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b28b-82f4-4135-a1cb-ffdaaf76ed8a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:41.956293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:41.956887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:41.957167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:41.957441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:41.958096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:41.958399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:41.959766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:41.967420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 224/447] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:41.972927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.010836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.018493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 224/448] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:27:42.024047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.069715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aad773-f70a-44d0-9001-a121c58a7af3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.085198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.103194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.103901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.104346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.104553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.119396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9d9d-1e57-4826-9790-ff7edc671e90 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.151591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.152237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.152519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.152789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] PATH_INFO: `/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.153889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] RBAC: Authorizing `identity:get_project(project_id=9f85ef77f8be4f4d9ae6c447129ea73f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.155323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.156949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 225/449] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/projects/9f85ef77f8be4f4d9ae6c447129ea73f => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:42.162943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.170793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.172278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.222247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.261098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8ad4-9ddc-4903-b481-d4357d63ad19 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.268696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 225/450] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:27:42.274285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.290646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.294714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.295427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.295717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.295985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] PATH_INFO: `/v3/groups/cbf89e89f8b44da680d056ea285438e5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.297117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf89e89f8b44da680d056ea285438e5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.299122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.300709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 226/451] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/groups/cbf89e89f8b44da680d056ea285438e5 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:42.306346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.369022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771eeac-9153-44ef-b5b8-963352eb958f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.402224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.402595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733132-43da-469b-8718-83f8b9cf3b95 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.403031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.403031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.403296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] PATH_INFO: `/v3/projects/7de78f52ec9a4de8b0175065fe065864` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.404418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] RBAC: Authorizing `identity:get_project(project_id=7de78f52ec9a4de8b0175065fe065864)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.405838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.407466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 226/452] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/projects/7de78f52ec9a4de8b0175065fe065864 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:42.413267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.430634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.436778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.437372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.437653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.437930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.438646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] RBAC: Adding query filter params (group.id=cbf89e89f8b44da680d056ea285438e5, role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=9f85ef77f8be4f4d9ae6c447129ea73f) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:42.438952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.440416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.445944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 227/453] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/role_assignments?group.id=cbf89e89f8b44da680d056ea285438e5&scope.project.id=9f85ef77f8be4f4d9ae6c447129ea73f&role.id=f6300a9e15d04a299f9847938352da84 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:42.497326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:42.513878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31351e-2462-4c4f-b50f-7ea405c32b2a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.549153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.549794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.550072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.550342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] PATH_INFO: `/v3/groups/286aba5d35b34cea9fd84c0964d99dff` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.551496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] RBAC: Authorizing `identity:get_group(group_id=286aba5d35b34cea9fd84c0964d99dff)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.552987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b73e1-084d-4ec7-b659-7814d84b16aa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.554583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 227/454] 10.222.0.73 () {56 vars in 1180 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/groups/286aba5d35b34cea9fd84c0964d99dff => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:42.560577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:42.661425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5232-dceb-4f0a-8dce-c343b30eb127 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:42.692380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:42.692976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:42.693253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:42.693524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:42.694234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] RBAC: Adding query filter params (group.id=286aba5d35b34cea9fd84c0964d99dff, role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=7de78f52ec9a4de8b0175065fe065864) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:42.694538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:42.695978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94809bf-fc50-470c-9ac9-8d10052db6b0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:42.701495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 228/455] 10.222.0.73 () {56 vars in 1376 bytes} [Thu Aug 18 16:27:42 2022] GET /identity/v3/role_assignments?group.id=286aba5d35b34cea9fd84c0964d99dff&scope.project.id=7de78f52ec9a4de8b0175065fe065864&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:45.042435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147226f0-cc1f-4b8a-ba1b-8ccfa8cd1bf2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.043380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147226f0-cc1f-4b8a-ba1b-8ccfa8cd1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.043874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147226f0-cc1f-4b8a-ba1b-8ccfa8cd1bf2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.045700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 228/456] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:45.051434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8801389-ade7-49af-b8f6-69b6f5062712 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.052302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8801389-ade7-49af-b8f6-69b6f5062712 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.052798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8801389-ade7-49af-b8f6-69b6f5062712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.072365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b8801389-ade7-49af-b8f6-69b6f5062712 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:45.073868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b8801389-ade7-49af-b8f6-69b6f5062712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:45.144651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:45.165064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 229/457] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:45.220624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24a9d-57fe-4158-9a2f-aa711c57987f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.220925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24a9d-57fe-4158-9a2f-aa711c57987f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.221178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e24a9d-57fe-4158-9a2f-aa711c57987f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.222767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 229/458] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:45.228222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddba83-7c32-4ff1-8929-2270825a6efa None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.228763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddba83-7c32-4ff1-8929-2270825a6efa None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.229254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddba83-7c32-4ff1-8929-2270825a6efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.253780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e0ddba83-7c32-4ff1-8929-2270825a6efa None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:45.255327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e0ddba83-7c32-4ff1-8929-2270825a6efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:45.339254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 230/459] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:45.405675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c5e2-b3a4-4c0b-8b0d-328dfb8de85f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.406275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c5e2-b3a4-4c0b-8b0d-328dfb8de85f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.406755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60c5e2-b3a4-4c0b-8b0d-328dfb8de85f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.408357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 230/460] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:45.413566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.414069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.414541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.437243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:45.438739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:45.511485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 231/461] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:45.640795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60c5e2-b3a4-4c0b-8b0d-328dfb8de85f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:45.769836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:45.801592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60c5e2-b3a4-4c0b-8b0d-328dfb8de85f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:45.865215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:45.865991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.866277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.866555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.868405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:45.882109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:45.883695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:45.899789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:45.900936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:45.902013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:45.902013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:45.902013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:45.903725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 231/462] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:45.904687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:45.912569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:45.926460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23ef09-37a7-4923-abc6-9a14adb8f598 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:45.962953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:45.963813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:45.964290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:45.964701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:45.975371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:45.977078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:45.993754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:45.994885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:45.995967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:45.995967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:45.995967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:45.997642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 232/463] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:45.998599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.023805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8dd9-9dd6-482e-b8ad-f1470546e496 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.071181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.071820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.072118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.072399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.085011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.086433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:46.101514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:46.102454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:46.103301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:46.103301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:46.103301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:46.103301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 232/464] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:46.103947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.131164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.135435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61974017-62c6-43da-ae17-c91c6d27e178 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.161138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.176350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.177237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.177732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.178203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.179046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:46.179540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.181262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a0c7-66e4-4e52-b98f-8c204b52e99b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.200625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 233/465] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:46.202234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b466-21f5-43c6-bfe5-0b3e01169f34 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.202606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b466-21f5-43c6-bfe5-0b3e01169f34 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.202947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6b466-21f5-43c6-bfe5-0b3e01169f34 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.204384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 234/466] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:46.209016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6b466-21f5-43c6-bfe5-0b3e01169f34 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.209627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df93650-4681-45eb-9052-cf4629405d02 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.243617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.244251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.244533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.244805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.245446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:46.245754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.247121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.260005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 233/467] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:46.260831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.322244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6b466-21f5-43c6-bfe5-0b3e01169f34 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.355754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.356385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.356665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.356935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.357563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:46.357867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.359245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae6db-b943-448c-ae58-7ec9dc048d6a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.369671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7eac7-1f20-4caa-be61-8395c45cb2d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.371166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 235/468] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:46.372357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.372640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.372910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.391141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:46.392378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:46.393277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.408238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.412801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.413372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.413645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.413916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.414542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.415962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.438379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 234/469] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:46 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:46.448338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.492629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 236/470] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:46.497106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.596906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9f9d9-4b4a-46f6-afab-83fb0cfeeb95 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.641514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.642171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.643109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.643109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.643367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.644859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d143f-80d3-4c8b-ac94-5e65bb978acb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.653908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98c333-7718-4b58-b76c-e859c73cc6dd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.666910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 235/471] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:46 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:46.668940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f73d-c1fb-47eb-a2ca-8a32976752b0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.668940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f73d-c1fb-47eb-a2ca-8a32976752b0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.668940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f73d-c1fb-47eb-a2ca-8a32976752b0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.670841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 236/472] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:46.676893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.677253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.677619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.697933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:46.698453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.699350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:46.699578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.700024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.700496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:46.701322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:46.703300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:46.730467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.732819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 237/473] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:46 2022] POST /identity/v3/users => generated 248 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:46.792923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 237/474] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:46.838221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:46.849296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:46.959815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369243c1-8c70-4a1d-b7e2-212b1852c094 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:46.996677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:46.997311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:46.997589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:46.997858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.009555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:47.011023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:47.029240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:47.030189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:47.031046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:47.031046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:47.031046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.031046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 238/475] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:47.036981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:47.090754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:47.166290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:47.180046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3335b-f0cc-45fb-b060-d58adbb56ac6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:47.219249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:47.219832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:47.220668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:47.220939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.224091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:47.224091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:47.224091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:47.237702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 238/476] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:47.242999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:47.261348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800e938-a0d9-47ac-83f8-5069eee80dab None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:47.283222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:47.330849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:47.331857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:47.332371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:47.332896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.333968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:47.335663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:47.353231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.sql.core [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:27:47.353231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 16:27:47.353231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [parameters: {'id': 'a3572bf0b6354f69a9c6612d18bfdd0a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 16:27:47.353231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:27:47.370480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:27:47.371411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application yield resource Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise self.value Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application session.commit() Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:27:47.372404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:27:47.373281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:27:47.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:27:47.375290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [parameters: {'id': 'a3572bf0b6354f69a9c6612d18bfdd0a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:47.377746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 16:27:47.379726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.383389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 239/477] 10.222.0.73 () {60 vars in 1131 bytes} [Thu Aug 18 16:27:47 2022] POST /identity/v3/roles => generated 144 bytes in 293 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:47.392412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:47.443469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97429-bd37-4bdf-b99b-60f2e5aa9c5f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:47.493377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58fe28-e039-4266-a0de-1c2f49d81b34 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:47.516119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:47.517645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:47.518127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:47.518651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.519483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:47.521135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:47.529792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:47.536754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:47.537388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:47.537766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:47.538041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.554123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:47.561789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 239/478] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:47 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-60a7d4c4-a87b-4c76-9112-de9c55b845bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:47.566284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:47.567245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:47.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 240/479] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:27:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:47.573662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:47.664734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:47.696019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e6d5-ee69-46c0-add6-b4576414afa1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:47.755574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:47.756249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:47.756595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:47.756932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:47.757668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:47.758074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:47.759554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb8aa5-f4ca-442a-9784-3276fa86a496 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:47.769889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 240/480] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:48.974806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb84e-6231-46cf-aef4-f77cf7219aa0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:48.975329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb84e-6231-46cf-aef4-f77cf7219aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:48.975329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb84e-6231-46cf-aef4-f77cf7219aa0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:48.977047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 241/481] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:48.982067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4d98e-0d3f-4ff6-be4d-3754155b859d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:48.982471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4d98e-0d3f-4ff6-be4d-3754155b859d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:48.982561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4d98e-0d3f-4ff6-be4d-3754155b859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.013113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-42c4d98e-0d3f-4ff6-be4d-3754155b859d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:49.014323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42c4d98e-0d3f-4ff6-be4d-3754155b859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:49.089301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 241/482] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:49.263052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437eb2e-8f11-444e-a850-74c116932e32 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.263241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437eb2e-8f11-444e-a850-74c116932e32 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.263510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437eb2e-8f11-444e-a850-74c116932e32 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.265006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 242/483] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:49.269974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85665db-05e4-44a5-a0da-514b9fd9416e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.270261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85665db-05e4-44a5-a0da-514b9fd9416e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.270535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85665db-05e4-44a5-a0da-514b9fd9416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.289728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c85665db-05e4-44a5-a0da-514b9fd9416e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:49.290895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c85665db-05e4-44a5-a0da-514b9fd9416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:49.351696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:49.359843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 242/484] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:49.379248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e499-cf24-474f-abe8-ac9f2dcee104 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.379536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e499-cf24-474f-abe8-ac9f2dcee104 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.379838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0e499-cf24-474f-abe8-ac9f2dcee104 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.381196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 243/485] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:49.386442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.386733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.387006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.409877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:49.411139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:49.450156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0e499-cf24-474f-abe8-ac9f2dcee104 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:49.482673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 243/486] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:49.629830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0e499-cf24-474f-abe8-ac9f2dcee104 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:49.664847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:49.674727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:49.675367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.675647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.675920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.696981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:49.701850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:49.702755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:49.703552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:49.704707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 244/487] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:49.710744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:49.795565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:49.821443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6910ac-98cf-478d-90a1-827e6364fdb7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:49.854240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:49.864588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e6334-e70e-40c0-95df-74dddec27031 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:49.866103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:49.867074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.868326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.868780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.882164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:49.888176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:49.889044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:49.889864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:49.893465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 244/488] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:49.894820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:49.905399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:49.906092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:49.906440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:49.906799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:49.908257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:49.908629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:49.910153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:49.925653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 245/489] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:49.926452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.024926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdec5b-9127-4b1d-8065-a2b5ab33f246 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.030880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f4d9-ba27-4f15-a300-7401fac4998e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.034178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.062464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.063493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.063988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.064530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.068884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.069494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.069777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.070053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.070716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:50.071084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.072646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.076911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:50.082269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 246/490] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:50.083173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:50.083748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.084651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:50.085475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:50.087985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 245/491] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.088997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.149321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.192358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2692024-8d3a-487d-bed7-258c56b3ddf1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.201479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492e90e-deea-4585-a516-5d5de7c59418 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.225366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.225983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.226262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.226537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.235050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.235692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.235974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.236277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.237056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.238488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.246715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.248173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:50.252842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.253699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:50.254640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:50.254640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.254640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:50.254640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 247/492] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.254640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b3afbc6a-021d-476e-8704-9314c713a842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:50.264486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.265377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:50.266243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:50.266243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.266243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:50.266243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 246/493] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.267520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03f4e-61c6-47ff-a6d5-efc4f235f6a1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.267804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03f4e-61c6-47ff-a6d5-efc4f235f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.268180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03f4e-61c6-47ff-a6d5-efc4f235f6a1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.269341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 247/494] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:50.270348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aa53-3e0e-490e-9ffa-9bbc71696203 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.270709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aa53-3e0e-490e-9ffa-9bbc71696203 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.270996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43aa53-3e0e-490e-9ffa-9bbc71696203 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.272044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 248/495] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:50.274545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43aa53-3e0e-490e-9ffa-9bbc71696203 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.280442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.359541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c356e0d-4fd9-4108-8919-444f510f0f1f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.368021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.374218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43aa53-3e0e-490e-9ffa-9bbc71696203 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.392477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.393071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.393348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.393619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.394268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:50.394566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.395932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.403968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 248/496] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:50.404720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.409332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.409946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.410228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.410501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.411138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:50.411444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.412841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3e79c-f2c4-4400-b1ce-0640ab8c28ac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.424604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 249/497] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:50.425781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4667cc-97f8-4e64-b81b-72dd9591da63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.426065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4667cc-97f8-4e64-b81b-72dd9591da63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.426337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4667cc-97f8-4e64-b81b-72dd9591da63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.443750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ff4667cc-97f8-4e64-b81b-72dd9591da63 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:50.444969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ff4667cc-97f8-4e64-b81b-72dd9591da63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:50.487356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.506676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e1aff-0cc7-499a-925e-1cc524b083c3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.510837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 250/498] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:50.521341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.521341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.521341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.529323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:50.530518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:50.550259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.550861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.551144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.551417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.552077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:50.552386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.553763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.570439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 249/499] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:50.570439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.606148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 251/500] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:50.607066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.633136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.680952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971daa5-a3bc-41ad-81ca-0587896c7a31 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.716387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.717169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.717517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.717875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.729276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.731794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.733390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.746155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252a152-0dc1-4251-99c6-7b8ddcf9efe6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:50.750237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.751677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:50.752568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:50.752568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:50.752568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:50.756540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 250/501] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.757628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.791042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.791991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.792476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.792923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.800603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.802229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:50.815469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.816383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:27:50.817291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:50.819183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 252/502] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.820108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.866239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c58539-1850-4ed4-99c9-a8471656487a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.899956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.900600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.900875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.901141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.904210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.908999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.910436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:50.922289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:50.923765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 251/503] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:50.924806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:50.931519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb315-9f3c-4f0b-b78b-8f4fefc3ea27 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:50.964644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:50.965249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:50.965523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:50.965794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:50.966426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:50.966729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:50.968112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:50.975205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:50.979652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 253/504] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:50.980456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.027681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068ecd-4470-4660-9955-789ea2741018 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.061484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.062102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.062383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.062656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.072518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:51.077727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:51.078785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:51.079795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:51.080584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e583db-575d-4446-b017-d3a4691d15e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.083592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 252/505] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:51.084503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.114500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.115100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.115377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.115648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.116395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:51.116696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.118172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.135552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.155287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 254/506] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:27:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:51.155939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.194875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263b005-3aa4-4981-82b0-e7cb2c77f775 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.207370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.228857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.229473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.229747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.230018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.241654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.243128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.255544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087ca11-2b11-42d2-ac2f-b39fc05a7140 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:51.257190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:51.258239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:51.259112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:51.259112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:51.259112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:51.259112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 253/507] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:51.259339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.292192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.292782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.293067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.293336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.294060 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:51.294366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.295809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.312751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 255/508] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:51.313379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.358459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d1d0-11c1-4714-a403-0c411484846a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.367257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.392202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.392822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.393101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.393381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.400612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.402043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.411896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7899-57f0-4738-bd60-ab6d15bef27f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:51.413303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:51.414361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 254/509] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:51.415314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.439016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.448323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.448938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.449220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.449490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.450142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:51.450442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.451807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.459997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 256/510] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:51.460791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.515600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003351c-d1c6-4a15-9431-7a27138179a2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.548817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.549411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.549688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.549957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.556350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c42997-f05e-4a5c-bd42-ede00c49c52d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.571749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.589425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.590016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.590291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.590558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.591181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:51.591477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.592850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.604534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 257/511] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:51.605297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.616374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.617829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.641091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.704574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb53845-0566-462b-a9e6-f87eae4e9503 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.713264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 255/512] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:51.715214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.742312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.742917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.743197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.743468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.787891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.810052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.811509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.812459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0ed5-8aa6-4606-b2bb-b9f1c83dba3b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.835934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:51.846605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:51.847200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:51.847478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:51.847750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:51.848504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:51.848809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:51.850229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:51.886095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 256/513] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:51.886897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.911342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 258/514] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:51.912169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:51.982745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c273e0-8960-486e-90da-3e99ef97546a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:51.987464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.011126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0071-4a82-4fac-b989-3ccf0c222cb2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.017153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.017779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.018056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.018327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.027966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.029445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:52.043517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.044579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:52.045521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:52.045521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.045521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:52.045744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.045744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.045744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.045744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.046013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 257/515] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.046079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.046153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.046891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.068275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 259/516] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:27:51 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:27:52.069079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.086542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.165195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb78a7-3f03-4b77-91ba-a242449808c1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.185267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dec968-0252-4ff3-aca9-23f2ea5c07b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.202738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.203363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.203638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.204083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.216029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.217433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.219367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.226029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.226993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.227246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.227742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:52.234450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.236052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:52.238011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:52.238011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.238011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:52.238011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 258/517] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.238011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.310769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.312346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.334502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.350287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0acef8-766e-4dcf-b1f9-753e0019bf9e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.385935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.386710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.387113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.387479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.398137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.399708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:52.414436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.415532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:52.416627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:52.416627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.416627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:52.422109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 259/518] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.422109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.422312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 260/519] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:52.422502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.455933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.526369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe27f-83ee-472f-b4b5-52df1b3f0812 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.530331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7259-cee6-4e44-91fb-32c2424a6218 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.563388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.564003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.564312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.564590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.565230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:52.565537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.566918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.569609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.570209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.570488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.570755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.571386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:52.571692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.573055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.573934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.580577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 260/520] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:52.581203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.590402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 261/521] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:52.591959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.685617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25afd6d-c2eb-449c-a3a2-ae2806cda673 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.693536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.703465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d0440-ca59-4a46-926a-f64fc2ed52a9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.727937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.728616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.728910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.729173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.741081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.742558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.742812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.743470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.743754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.744028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.744701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:52.745009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.746360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:52.763063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.764010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:52.764898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:52.764898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:52.764898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:52.765104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 262/522] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:52.765104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.765228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 261/523] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.765228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.820694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:52.868339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03a45-0cd8-43e2-ac1d-5f53983ed865 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.874739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4ed9f-12db-4a30-8e26-e9f30f00c99b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:52.902607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.903514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.903797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.904250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.910014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:52.910641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:52.910923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:52.911199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:52.912091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.913530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.918069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:52.919493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:52.924980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.925894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 263/524] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.926970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:52.936507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:52.937394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:52.938259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 262/525] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:52.938755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:52.944045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.036692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d5620-ada1-4e66-8511-2ba295298187 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.045446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084c43c-d4e0-4b90-883d-362a1f95218b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.056050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.073433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.074264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.074701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.074965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.082552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.083134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.083734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.083992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.084123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.084325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.084957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.085260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.086628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:53.097302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:53.098291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:53.100266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:53.100721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 263/526] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.100721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.109796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 264/527] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:53.109796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.180696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.212872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc71e-0c7a-4341-bcbd-9345867d0438 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.214347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f469-0958-4ccc-bfe3-cfe395d5a87a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.247355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.248156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.248446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.248719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.249442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.250102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.250395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.251036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.251319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.251574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.251667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.252325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.252635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.254054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.269086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 264/528] 10.222.0.73 () {56 vars in 1139 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.269891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.274681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 265/529] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.275645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.300318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.372328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d5ea3-b144-401f-af4a-d8a62c41376d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.394519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e027f-56e9-4401-976f-71addb3b112a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.408426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.409054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.409342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.409618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.416815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.418278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.425588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:53.429699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:53.430764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 265/530] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:53.431880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.436692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.437314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.437595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.437864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.439090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.439439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.440912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.459234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 266/531] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.459234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.527952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.544343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883119f9-287b-4633-983e-cc47a5206d0f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.563147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e957c-d6ff-4b07-bb72-3a5709295487 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.578195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.578797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.579669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.579930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.599426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.600303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.600856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.601135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.601949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.602262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.603854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.620085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 267/532] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.620085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.667335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.668981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.696020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.770291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806b8e-ee84-4005-9a68-4e57c9864f2b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.783810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:53.806190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 266/533] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:27:53.811449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.819870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.821175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.821630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.822046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.823291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.824023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.825959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.843589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 268/534] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.844704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.936158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85b34-4bb8-4b53-a0b0-cd6be8076865 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.967209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6891-a247-487b-a006-c04e8bbc5c5e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:53.972913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:53.973634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:53.974015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:53.974388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:53.975215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=4fd9346df56842ec95720f6d4e859559) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:53.975645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:53.977393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:53.988108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 267/535] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/role_assignments?user.id=4fd9346df56842ec95720f6d4e859559&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:53.988108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:53.996649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:54.027456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.028617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.028914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.029486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.044404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:54.046936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:54.054131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9aac74ce-31f3-48a0-9322-4b3e2a922a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:54.068424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:54.069400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:54.070262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:54.070262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:54.070262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:54.070262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 269/536] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:54.072092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4221-6069-4e8a-823e-d7eaaf1ef8bc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.072501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4221-6069-4e8a-823e-d7eaaf1ef8bc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.072836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4221-6069-4e8a-823e-d7eaaf1ef8bc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.078469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 270/537] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:54.079444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb4221-6069-4e8a-823e-d7eaaf1ef8bc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.111835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d947d-ac22-47cb-bc88-a68b79997434 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:54.151469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.151469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.151469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.151469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.152052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=8ee82cc4136a4b23aeaf4e115fe7bd5a) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:54.153811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:54.153811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192028-2134-4281-89dd-f9987c1f6feb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:54.164400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 268/538] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:53 2022] GET /identity/v3/role_assignments?user.id=8ee82cc4136a4b23aeaf4e115fe7bd5a&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:54.165733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.166293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.185991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:54.187290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:54.215814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb4221-6069-4e8a-823e-d7eaaf1ef8bc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:54.258892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.259514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.259790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.260076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.260731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:54.261029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:54.262432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:54.277883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 271/539] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:54.283293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.330168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:54.352198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 269/540] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:54.406496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f6f7-3f1c-49f0-886b-f190bc730d88 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:54.447504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.448479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.448958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.449422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.456777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:54.458462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:54.479024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:54.479932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:54.480818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:54.483154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 272/541] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:54.489628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.588676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:54.650520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9356b-7f78-4065-a6af-e356748a8edf None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:54.670283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.690642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.691254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.691533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.691799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.692531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:54.692837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:54.694277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:54.728874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 270/542] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:54.736106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.817399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:54.832068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c176b7-b5f5-4a58-a146-a1897de77b49 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:54.871891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:54.872547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:54.873818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:54.874089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:54.893364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:54.898134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:54.899012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:54.899803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 273/543] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:27:54.905239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:54.990269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7d94b-3ec3-4fdc-abba-029fa0d8e148 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.003061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:55.009486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107da53-af06-4a20-9081-ad10cff209fc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.054294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.055195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.056013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.056521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.056817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.057107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.057384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.057642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.058120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:55.058428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.058978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=2be1be9e39a74168887220f2a4cc20d5) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:55.059484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.059852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.061338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.067570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 271/544] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/role_assignments?user.id=2be1be9e39a74168887220f2a4cc20d5&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:55.077809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 274/545] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:55.083563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:55.219071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c11095-4df3-496a-82b1-175bf87fd464 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.258434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.259417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.259920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.260424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.274277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.276111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:55.292831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:55.293782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:55.294641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:55.294641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:55.294641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:55.296778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 272/546] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:55.304166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:55.324979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:55.441812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a33f8-cdce-4d22-811f-5f9a95c301cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.491473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.492095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.492382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.492653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.493290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:55.493593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.494956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.511804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 275/547] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:55.517864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:55.576086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:55.668211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c099956-680d-4f3e-82f8-074264f9c978 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.718677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.719772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.720284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.720766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.736793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.738252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d084c892-366d-4f56-9439-da8bb93cf77f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:55.757359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:55.758302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:55.759774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 273/548] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:27:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:55.764219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:55.838115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64c93-b878-4313-8d71-675d214db1be None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.838443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64c93-b878-4313-8d71-675d214db1be None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.838683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64c93-b878-4313-8d71-675d214db1be None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.840011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 274/549] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:27:55.846530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9b5d-28ed-4b77-a010-f5d82314c69d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.846781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9b5d-28ed-4b77-a010-f5d82314c69d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.847447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9b5d-28ed-4b77-a010-f5d82314c69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.868426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:55.881995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-666e9b5d-28ed-4b77-a010-f5d82314c69d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:55.883197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-666e9b5d-28ed-4b77-a010-f5d82314c69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:55.921838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2238-79be-476f-946b-dc2c4e04b26d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:55.972218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:55.972843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:55.973121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:55.973390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:55.974123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:55.974429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:55.977426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:55.994476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 276/550] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:27:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:56.000171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.030531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 275/551] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:56.113490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2294e-18de-4fe2-a2d0-96c0538e6b34 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:56.140710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.148703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:56.149312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.149638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.149909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.219062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:56.220592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:56.321242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392dd3a-62c8-41bb-9bd0-2901aaf21a95 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.321729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 277/552] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:27:56.322526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392dd3a-62c8-41bb-9bd0-2901aaf21a95 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.323010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392dd3a-62c8-41bb-9bd0-2901aaf21a95 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.324844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 276/553] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:56.332654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.336093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.336093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.336093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.361409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.369659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:56.370868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:56.386985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.442174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489d414-4c05-46b5-886d-d68760853e47 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:56.476924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 277/554] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:27:56.477805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.484635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:56.485842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.486136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.486446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.502222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:56.504010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:56.529339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:56.530484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:56.531351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:56.531351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:56.531351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:56.531533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 278/555] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:56.537267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.614850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799585-f638-4c43-b60e-2c7af17ad45b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:56.648183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.659251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:56.660161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.660445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.660718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.669535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06449b0-2b94-4ed9-8d0b-3aba2b18ca7b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:56.674513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7849a32f-ed43-43d4-8629-bcdb79530bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:56.680985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:56.682501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 278/556] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:56.684035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f5f-e1eb-49b9-9251-492983b0b9a1 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.685371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f5f-e1eb-49b9-9251-492983b0b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.685371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f5f-e1eb-49b9-9251-492983b0b9a1 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.688091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 279/557] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:56.690117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c8f5f-e1eb-49b9-9251-492983b0b9a1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.693967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.719005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:56.720655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.721386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.721826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.722641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:56.723121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:56.725493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df307840-eae8-40d0-a78d-4508b1cefd5d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:56.746634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 279/558] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:56.749030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.749774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.752419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.776458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:56.778619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:56.831871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c8f5f-e1eb-49b9-9251-492983b0b9a1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:56.862246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 280/559] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:56.863418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.885549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:56.886227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:56.886618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:56.886979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:56.888377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:56.888778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:56.891021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:56.904229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 280/560] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:27:56.905769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:56.957807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:56.992479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.000246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afe0a6-25bc-4022-b211-969d806c27ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.042481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e6a6-c663-4622-b9fb-00b5c97c0e54 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.054300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.055472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.055841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.056428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.064658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.066546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:57.079363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.080572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:57.081668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:57.084194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 281/561] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.085150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.089769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.090597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.091022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.091549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.103527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:57.110161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.112274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:57.113138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:57.120376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 281/562] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.121511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.200185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e903ced-b793-4e49-a3cc-7b98951005ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.231471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.235849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152594a-6e81-46b0-abc6-efa9a9ae4c8e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.239816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.240479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.240760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.241028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.253366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.254807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.260412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:57.270784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.271840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:57.272758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:57.272758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:57.272758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:57.272758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 282/563] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.273557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.275770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.276443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.276718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.277099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.277790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:57.278781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.279643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.297480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 282/564] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:57.297480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.383152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c185c7-2601-4710-9307-cdc7ff6ea9e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.402493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3760d0-5817-484e-aa9f-b349e01de5a1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.417647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.418248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.418526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.418801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.419449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:57.419748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.421143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.429068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 283/565] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:57.429892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.437077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.437697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.437972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.438257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.448539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:57.453203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.454848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 283/566] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.455716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.476772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.502318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.529174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee8306-deed-4a38-b7b3-70821ae2e630 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.555773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43324e3-085e-459c-9cbb-8c40621a0cf3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.563531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.564266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.564546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.564820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.565456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:57.565768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.567131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c382169-8c28-4af2-9270-5839f0db223e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 284/567] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69d34-1ff3-4352-ab88-8aa298a8330d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69d34-1ff3-4352-ab88-8aa298a8330d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69d34-1ff3-4352-ab88-8aa298a8330d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 285/568] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:57.583298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c69d34-1ff3-4352-ab88-8aa298a8330d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.596416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.597225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.597515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.597773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.598483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=c47af3f28f044f68a90e6a78ee3102a6) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:57.598790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.600257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.605613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 284/569] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/role_assignments?user.id=c47af3f28f044f68a90e6a78ee3102a6&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:57.606378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.693834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c69d34-1ff3-4352-ab88-8aa298a8330d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.697591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.738851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a71db-9800-40c8-b01e-10c6acdead27 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.741312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.741944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.742221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.742493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.750537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:57.754223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.755707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:57.771073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.772260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:57.778457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:57.778457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:57.778457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:57.778457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 286/570] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.778457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.788121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.789027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.789808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.790148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.791127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:57.791520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.793557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521ea3-4228-45b9-93dc-80d60346dc4a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.809794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 285/571] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:57.809794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.809794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.809794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.827411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:57.828630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:57.879117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e882f-0081-4ed1-a813-3c60c9e1f848 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:57.908095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 286/572] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:57.908095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.913189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:57.913826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:57.914104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:57.914372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:57.922101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:57.923574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:57.934787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:57.935740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 287/573] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:57.936722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:57.961685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.035454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.038429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1d58c-9012-4e3a-9640-7b50e0231944 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.069537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912702c-025b-4721-81fe-eefccd51fb98 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.083765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.084576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.084849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.085114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.085745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.086041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.087396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.103541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 287/574] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.104652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.121867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.123084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.123589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.124346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.139382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.140893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:58.155801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:58.156910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:58.158008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:58.158008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:58.158008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:58.158008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 288/575] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:58.158234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.227558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.233019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af46395-22d1-44a5-abf3-b536e241129b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.262700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585c92-a372-4704-9678-e611dd1e05e8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.270104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.270700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.270970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.271349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.272074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.272397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.273923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.291948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 288/576] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.292712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.296105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.296774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.297062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.297341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.305304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.306772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.312794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:58.318335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:58.319437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:58.320825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 289/577] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:58.324617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.401102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c5aa2-0042-49b8-85d7-4556be9fbfa0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.428450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce892d5-48d4-4118-91ff-17d5191d6f19 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.437609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.439613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.439893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.440502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.441206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.441448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.442816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.454957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 289/578] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.456531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.460233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.464971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.465598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.465876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.466145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.476824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:27:58.481918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:58.482827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 290/579] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:58.484591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.550259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.573179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1427-0d5a-42d9-bbc9-7c60a271bc73 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.590566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109ade8-4360-434d-8d0c-4487c21cca28 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.609175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.609847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.610713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.610996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.621980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.623407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.626451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.627061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.627340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.627611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.628356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.628660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.630186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:58.638538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:58.639496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:58.640471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:58.640471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:58.640471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:58.640471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 290/580] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:58.640471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.655011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 291/581] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.655011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.704966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.756421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d328-d6cc-40e6-a816-f8445a13db59 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.771920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671cf85-f995-48e6-ba19-64279320d13c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.785184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.791246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.791959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.792332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.792675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.800852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.802325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.807971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.808597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.808880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.809156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.809810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.810119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.811457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:58.813575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:58.814522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 291/582] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:58.815478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.822953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 292/583] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.823841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.930369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351dec9-ee91-4203-89ff-00d9a0d05846 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.930622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f3b3b-cae7-4b0a-9bdb-46ebc7e3ab50 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:58.940181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:58.966685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.967283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.967568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.967848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.968521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:58.968828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.970447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:58.970752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:58.971375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:58.971806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:58.972307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:58.982334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 292/584] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:58.983128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:58.987962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:58.989519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:59.005081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.006052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:59.006940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:59.006940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.006940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:59.006940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 293/585] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.007174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.039136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.089501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea0c1b-1f40-47c7-9107-c71ea19120ac None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.116018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381945a7-cbf0-487f-ac68-bc070e1e0922 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.125550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.126200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.126476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.126740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.127456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:59.127756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.129208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.146906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 293/586] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:59.147715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.154644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.155490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.155964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.156433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.168940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.170598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:59.185601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:59.187469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:59.187469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.187469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:59.190148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 294/587] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.190736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.207692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.259372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93998e-ec08-46b2-a1fe-ba223e0a5d22 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.269133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.295946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552f7e-081f-40ba-8b52-2e53fa4c26fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.296877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.297743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.298619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.298906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.305742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.307275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:59.318956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.319883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 294/588] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.321169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.334148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.334750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.335024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.335289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.335922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:59.336277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.337595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.349565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 295/589] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:59.350324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.429400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.430799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970812-40ff-4411-ac5c-a5d6598dcb6a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.462076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40209e-c1cf-41f9-aa42-9c9846e143eb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.466851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.467486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.467765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.468036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.479393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.480867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:27:59.495924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.496956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:27:59.497861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:27:59.497861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:27:59.497861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:27:59.497861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 295/590] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.497861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.500248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.501002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.501291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.501549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.502399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:59.502705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.504092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.515665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 296/591] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:59.516521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.524755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.604659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff551-6184-4093-819b-51c9415bac94 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.615486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a5012-fd38-41ad-a5ad-0343b106c45a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.638101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.638697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.638972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.639241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.640015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:59.640330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.642540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c166b-7711-4fdb-b22a-6c9086897458 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.644743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.650021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.650637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.650911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.651178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.654996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 296/592] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:59.656214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e808f4-2313-4be9-952c-73c20b6141b3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.656503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e808f4-2313-4be9-952c-73c20b6141b3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.656784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e808f4-2313-4be9-952c-73c20b6141b3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.658553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 297/593] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:27:59.659243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e808f4-2313-4be9-952c-73c20b6141b3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.661522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.663246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:27:59.674500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.675559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 297/594] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.676694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.745126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.765012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e808f4-2313-4be9-952c-73c20b6141b3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.774371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b8af-461c-4b3d-b702-f8c3cae5a6be None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.799458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.800094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.800370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.800647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.801279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:27:59.801586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.802962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.807099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.807717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.807996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.808296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.814070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 298/595] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:27:59.814674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.816249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.817679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-99d09917-971c-4d83-bf6a-d678172cb685 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:27:59.828646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:27:59.830256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:27:59.831523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 298/596] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:27:59.832282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.832282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.832282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.849376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:27:59.850551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:27:59.897536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.917254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 299/597] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:27:59.918109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:27:59.918381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43583bc3-a4cd-4217-87e4-3ec13853fa45 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:27:59.960650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:27:59.961531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:27:59.961930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:27:59.962200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:27:59.974226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:27:59.979441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=92d15db5127347b8b25cdf41abb2ab07, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:27:59.981606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.004724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 299/598] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:27:59 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:00.005547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.018990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def354-ae40-418d-b376-5022aa3a6a99 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.058469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.059512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.059987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.060591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.061519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:00.062026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.064433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.083103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 300/599] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:00.084424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.126276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329f77-3684-4d1c-9b90-883385b441b2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.132268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.165277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.165969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.166245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.166511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.175095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.176819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:00.188115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:00.189554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:00.190432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:00.194468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 300/600] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:00.195201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.203659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d328b-58e6-4a4a-8ee3-ad728f1a2552 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.237963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.238667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.239016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.239355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.240182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:00.240556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.242047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.246950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.262164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 301/601] 10.222.0.73 () {56 vars in 1139 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:00.262942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.308106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f73326-838a-4090-833c-ce4d900c4d39 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.345725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.346384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.346660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.346930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/4fd9346df56842ec95720f6d4e859559/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.363361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=4fd9346df56842ec95720f6d4e859559, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.364853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.365910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.369265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80db4-8e80-4603-9419-8861303f8d49 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.378126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 301/602] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:00 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/4fd9346df56842ec95720f6d4e859559/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:00.379133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.427810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.428571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.428928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.429272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.446220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:00.452308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:00.453554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:00.454639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:00.456326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 302/603] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:00.458058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.514362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.519735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ed163-482a-4839-8fe9-b95e852583ca None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.575581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.576291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.577340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.577340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.577537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be06ec-e337-4171-893f-02dc68afbc39 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.577639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:00.577793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.579352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.591614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 302/604] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:00.592500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.618154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.619020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.619461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.619871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.630979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.632612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:00.647581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:00.648817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:00.649917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:00.649917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:00.649917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:00.651668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 303/605] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:00.656846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.672074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.713295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc42-f4e9-4979-bc85-3fa1de6e615c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.762036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.763272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.763761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.764199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.765069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:00.765510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.767317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.775540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104a9e-cd3e-4097-839c-e2c1a5089930 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.781048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 303/606] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:00.782693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.810527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.811298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.811837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.812155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.812426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/8ee82cc4136a4b23aeaf4e115fe7bd5a/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:00.827376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=8ee82cc4136a4b23aeaf4e115fe7bd5a, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:00.828876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:00.852092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 304/607] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:00 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/8ee82cc4136a4b23aeaf4e115fe7bd5a/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:00.852092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:00.914062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:00.950427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8771-a86d-4f78-91e6-4e3ea0c79073 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.958334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded058b-3b91-4117-bd3f-133dabddf594 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:00.997173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:00.997740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:00.998018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:00.998288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.009987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.011638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:01.027903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:01.029193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:01.030235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:01.030235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:01.030235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:01.030235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 305/608] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:01.041106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.057748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.058388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.058866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.059188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.059958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:01.060301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.061823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.075378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 304/609] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:01.082090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.170540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f870f3-819b-4db1-bfdb-64eacf156773 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.198399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:01.211372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.212182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.212565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.212937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.213689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:01.214094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.215649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.230465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 306/610] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:01.236329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.284213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:01.323832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135790b0-6b46-4c81-b6cf-aa939e7fbb20 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.389770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.391010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.392115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.393087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.405062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.407930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.410937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c657ee7-cfc6-428f-a6cc-6cc28269782a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:01.430462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:01.431574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:01.432593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:01.435236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 305/611] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:01.442894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.491631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.492330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.492571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.494853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.513526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.515046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:01.540385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:01.541330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:01.542261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:01.544869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 307/612] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:01.550814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.592095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd4e4a-6ae4-4070-9f2d-908230bef654 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.608342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:01.644817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.645486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.645768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.646038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.646732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:01.647038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.649068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.674156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 306/613] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:01.681348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.689418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:01.733667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e05ff-67aa-4930-88e1-c4419b5a3b74 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.773432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.774056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.774337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.774611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.775343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:01.775650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.777831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:01.816340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 308/614] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:01.819640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:01.866151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374464cd-300b-4b07-9914-e2c0b3fc1f19 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.943864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:01.944547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:01.944830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:01.945103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/2be1be9e39a74168887220f2a4cc20d5/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:01.953603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:01.968362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0abed-bbbf-4258-a711-d5cc6ba2ae3d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:01.980907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=2be1be9e39a74168887220f2a4cc20d5, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:01.982355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24ff0-96b2-47bd-b950-4472410b5f92 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.001896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 307/615] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:01 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/2be1be9e39a74168887220f2a4cc20d5/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:02.017720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.018403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.018680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.018944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.030576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.032254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:02.049001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:02.050021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:02.050985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:02.050985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:02.050985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:02.050985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 309/616] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:02.053124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a979-68ac-46b0-b5b6-5d50fca3e056 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.053449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a979-68ac-46b0-b5b6-5d50fca3e056 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.053718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3a979-68ac-46b0-b5b6-5d50fca3e056 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.055289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 308/617] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:02.060420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.060906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.061188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.061470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.089393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:02.091316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:02.164475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:02.176574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 309/618] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:02.237074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc52cc-8873-4fb4-8ea9-250355050403 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.276571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.277188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.277468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.277734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.278368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:02.278668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.280026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.296403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 310/619] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:02.302409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.441857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b74cb-ffe8-4858-8ca5-e91655da7766 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.479504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.480582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.481060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.481526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.488961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.493256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.494921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.506289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:02.507189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:02.508072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:02.509592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:02.510050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 310/620] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:02.515611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.563747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:02.665956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902db7-da4c-4a8d-af01-fb49b19fa3ce None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.676016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40d97-7838-4177-a8f0-ffbc1b98ecc2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.716148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.717113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.717591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.718054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.729707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:02.736182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:02.737109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:02.737951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:02.740973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 311/621] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:02.749422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.776494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.777124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.777405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.777677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.778383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:02.778689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.780155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3ca7-27c6-4744-bd6a-9d1be94db9a9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.793080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 311/622] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:02.794396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954b41b-a208-4f5d-a110-d0aa43982c2a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.794689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954b41b-a208-4f5d-a110-d0aa43982c2a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.794964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954b41b-a208-4f5d-a110-d0aa43982c2a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.796205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 312/623] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:02.801601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954b41b-a208-4f5d-a110-d0aa43982c2a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:02.820042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:02.860706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82abe8-8a4d-489b-af14-b2332c4d6f29 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.896345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.897195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.897619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.898054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.898851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:02.899309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.900900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f81624-b117-4fb0-a106-54e33f1d748d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.905998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954b41b-a208-4f5d-a110-d0aa43982c2a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:02.914380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 312/624] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:02.915893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53806b-3003-4bd6-beef-f9307b711364 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.916410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53806b-3003-4bd6-beef-f9307b711364 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.916861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53806b-3003-4bd6-beef-f9307b711364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.925098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:02.935227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e53806b-3003-4bd6-beef-f9307b711364 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:02.936535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e53806b-3003-4bd6-beef-f9307b711364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:02.948023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:02.949184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:02.949782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:02.950108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/c47af3f28f044f68a90e6a78ee3102a6/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:02.968648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=c47af3f28f044f68a90e6a78ee3102a6, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:02.970702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:02.988330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 313/625] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:02 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/c47af3f28f044f68a90e6a78ee3102a6/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:02.989523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.024233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 313/626] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:03.110865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be0da-0464-4088-9f92-0187ef6483a7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.148896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8be14-c623-4f26-bced-396ed3635868 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.149541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8be14-c623-4f26-bced-396ed3635868 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.150019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8be14-c623-4f26-bced-396ed3635868 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.150127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.150707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.151017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.151299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.152678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 314/627] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:03.159107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.159703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.160240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.164239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:03.165812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:03.180809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:03.182378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:03.186808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:03.187801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:03.188807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:03.188807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:03.188807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:03.188807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 314/628] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:03.195215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.200442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.255165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.274546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 315/629] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:28:03.321785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442637-340d-4162-a5bc-64ebf685c326 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.333464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.377751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.378364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.378643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.378914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.379561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:03.379861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:03.381266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:03.405423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 315/630] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:03.412921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.466128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c135b48-2171-4f0b-8c11-5b556a2561aa None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.505090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.505792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.506015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.506347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.517654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:03.522315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:03.523216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:03.524050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 316/631] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:03.530941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.563263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.605389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.635030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50223c-856a-45e4-82c3-c7ef5de3c2ba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.663221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2bb22-18f7-49bc-b048-ce60700e6f65 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.679652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.680561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.680850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.681149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.689580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:03.691025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:03.701388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.701990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.702267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.702534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.703187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:03.703292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:03.704768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:03.705718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:03.706252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:03.706252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:03.708145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 316/632] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:03.708941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.718728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 317/633] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:03.720138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.823316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786e54a-4db7-4168-b884-6f7ea15f93ab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.828124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9f37-395d-467b-8f48-f7df8e7be1e2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:03.832838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.855792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:03.859283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.859884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.860271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.860485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.861261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:03.861574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:03.863031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:03.870316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:03.871196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:03.871667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:03.872247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:03.885274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:03.887011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 318/634] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:03.887942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:03.892283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:03.893205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:03.894030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:03.896591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 317/635] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:03.902179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:03.990300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b516e-ec53-48be-b4fb-0f5a929d8c62 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.012249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeda9d-e992-486c-a0bf-0be16281e7dd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.025711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.026350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.026628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.026902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.037357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.038984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.050129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.051043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.051513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.051972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:04.054560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:04.055486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:04.056409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:04.056409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.056409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:04.056409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 319/636] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:04.057046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.077097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.113121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.131514 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.133272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.163066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ce1a-0288-46a0-9f2d-27afaa45dc39 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.199011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.199693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.199980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.200274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.200935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:04.201238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.203111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.215585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 320/637] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:04.215585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.244924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 318/638] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:04.246104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.304042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.325571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c291c-22a6-44e0-b36e-ca113d10e9f4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.339521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.358094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484098ee-bb8b-4b19-8a50-3fc46ed07fce None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.363719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.364358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.364638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.364907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.365542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:04.365841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.367203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.380786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 321/639] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:04.381575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.400809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.401571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.401907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.402182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.412612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.414045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-effcd2b1-bfda-4f94-89c3-c7f17d55e9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:04.429367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:04.430302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:04.431197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:04.431197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.431197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:04.431197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 319/640] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:04.431928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9ad1-5df2-4b7a-b932-5a706eb6f3ee None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.431928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9ad1-5df2-4b7a-b932-5a706eb6f3ee None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.432223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9ad1-5df2-4b7a-b932-5a706eb6f3ee None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.433504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 320/641] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:04.434054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9ad1-5df2-4b7a-b932-5a706eb6f3ee None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.497172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7611e3-e184-4464-ac63-e346d0bec473 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.536354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.537675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.538128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.538540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.544521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a9ad1-5df2-4b7a-b932-5a706eb6f3ee None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.549373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.551439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.552930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c294a53e-8481-4de4-9f69-6ea85623b1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:04.568275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:04.569358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:04.570257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:04.570257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:04.570257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:04.573932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 322/642] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:04.575392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e819f-ea27-4021-8707-f570873d411d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.575498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e819f-ea27-4021-8707-f570873d411d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.575690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e819f-ea27-4021-8707-f570873d411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.583327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.583958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.584266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.584546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.587799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.593214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.593471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-013e819f-ea27-4021-8707-f570873d411d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:04.595221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-013e819f-ea27-4021-8707-f570873d411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:04.595967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:04.607681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:04.608639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:28:04.609734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:04.613863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 321/643] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:04.614743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.665392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 323/644] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:04.666240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e819f-ea27-4021-8707-f570873d411d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.746726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fd4e1-86ec-492e-823a-7124fab62845 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.782825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.783432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.783713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.783987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.784660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:04.784965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.785726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e819f-ea27-4021-8707-f570873d411d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.786334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.802893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 322/645] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:04.802893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.816604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.830697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.831684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.832248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.832776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.833690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:04.834193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.835909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.848879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 324/646] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:04.850042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.862524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:04.907600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c257853-cd1b-4ba6-860f-23a49a33d1bd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:04.942887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:04.943519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:04.943802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:04.944099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:04.944825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:04.945131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:04.946710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:04.965032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 323/647] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:04.965844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:04.966730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9e03-a8bf-4e67-a243-bac1946b9823 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.000661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.001822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.002065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.002395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.009707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.011136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:05.022018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:05.022963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 325/648] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:05.023909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.070958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.077234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c4051-ca01-407b-b4a2-319c5535da98 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.091288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.114448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.114982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.115263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.115665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.122779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.124351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.130873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090075-09db-420b-948f-e80e89ba992d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:05.136200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:05.137234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 324/649] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:05.138941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.164314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.164992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.165213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.165486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.177245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:05.182353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:05.183276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:05.184157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 326/650] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:05.184864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.240411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dc9b0-e87a-43a2-8fbe-5cdd471040cd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.274703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.275306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.275587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.275898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.287671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdbd07-6f69-4353-8ad4-622638d89d31 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.289329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.319007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.321656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.322261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.322534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.322804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.323527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:05.323835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.325295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de441f4f-c027-4749-bcd1-15bf7bef4b55 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.342055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 327/651] 10.222.0.73 () {56 vars in 1137 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:05.343267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8101-0d8d-46a6-a692-0bcd33cbbe81 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.343551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8101-0d8d-46a6-a692-0bcd33cbbe81 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.343823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e8101-0d8d-46a6-a692-0bcd33cbbe81 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.345537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 328/652] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:05.346226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8101-0d8d-46a6-a692-0bcd33cbbe81 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.349783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.351234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.444448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e8101-0d8d-46a6-a692-0bcd33cbbe81 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.448378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 325/653] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:05.449191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.477707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.478302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.478581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.478847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.479526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:05.479827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.481275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.493004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 329/654] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:05.493777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.518482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.522747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.548489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a5bc-06a2-44ba-bf3d-b82ef60c065e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.580731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.581326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.581605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.581875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.582527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:05.582825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.584220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e244-5f2e-423d-a811-391fbca52145 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.591838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 326/655] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:05.593128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.593579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.593848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.595456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319ac00-7bbf-49aa-b708-2233a861ee8b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.611685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:05.612887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:05.628838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.629471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.629751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.630028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.677101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 327/656] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:05.678029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.697125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.698507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.719370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.773260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.799144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 330/657] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:05.799974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.814740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c85431-d54f-46b5-988f-6839c02b20b2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.850111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.850737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.851015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.851284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.861782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.863232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:05.878430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:05.879384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:05.880300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:05.880300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:05.880300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:05.880300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 328/658] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:05.880543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.903336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61544641-a1b4-4e6b-a809-103fbd92dac5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:05.925555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:05.941370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:05.941970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:05.942249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:05.942520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:05.943232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:05.943536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:05.945219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:05.950857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 331/659] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:05.951572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:05.984344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbdaf-fac3-4dd7-940c-31a241bf4e74 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.004752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.024750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.025456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.025735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.026007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.039145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.040696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:06.055506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.056648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:06.057544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:06.057544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.057544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:06.057544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 329/660] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.057544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.076863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8481b-5139-4224-9661-9e3bf1ca03a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.118580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.119215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.119507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.119777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.131582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.133294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:06.147622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.148647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:06.149537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:06.149537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.149537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:06.154352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 332/661] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.154855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.174333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54bfe-c72e-4b55-8830-2599c38e7a97 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.198538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.212899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.213517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.213764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.213977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.214622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:06.214929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.216325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.233432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 330/662] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:06.233432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.271267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22656db6-a54f-4191-bc78-028529668f95 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.272341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.307272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.307899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.308200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.308470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.319669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:06.324802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.325823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:06.326680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 333/663] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.327371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.351060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ded74d-177e-4924-84da-148856a38374 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.388595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.389336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.389617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.389993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.390622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:06.390923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.392984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.409621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 331/664] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:06.410617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.422199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.429270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b347-2dd9-4e4c-9dbc-049b05c96080 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.465779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.466299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.466583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.466856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.467491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:06.467800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.469219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.481265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 334/665] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:06.482055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.512590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.525232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149638c6-5f94-4ca3-8072-6a1e225f303c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.560531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.561158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.561430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.561707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.569195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.570633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:06.581948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.582836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 332/666] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.583733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.591448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91aea3-1654-49ff-b3e7-43e62ed38969 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.627149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.627855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.628190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.628520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.629235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:06.629597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.631065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.643585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 335/667] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:06.643585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.660507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.700186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd88e4-a889-4500-bd45-524315e64516 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.747469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.748369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.748572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.748923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.752030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345d270-2463-46c9-822d-fe83cd30da9e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.757502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.759391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:06.770603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.771758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:28:06.772978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:06.774915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 333/668] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.774915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.788087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.792878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.793511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.793791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.794062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.801220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.802664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:06.814036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.815102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:06.816193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:06.818047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 336/669] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.818488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.891373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bfb64-c685-4e5e-b542-ef407f84fedd None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.897308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:06.921653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd84875-6767-4d22-b7b3-64bfc78b2f6c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:06.928965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.929587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.929836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.930104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.930845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:06.931152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.932601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.950260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 334/670] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:06.950260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:06.963435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:06.964080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:06.964370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:06.964640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:06.975926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:06.977400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:06.992443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:06.993594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:06.994937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:06.994937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:06.994937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:06.998268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 337/671] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:06.999138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.029096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.062234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c41c2-8155-48f5-8216-5f6954939088 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.102052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.102662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.102947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.103397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.103942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:07.104278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.105708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.106313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45f1f4-1ac6-4b88-9898-e0016528c54e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.125163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 335/672] 10.222.0.73 () {56 vars in 1139 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:07.126092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.138389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.146609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.147107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.147385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.147656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.148376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:07.148679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.150120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.167418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 338/673] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:07.167418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.238752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8606f-122b-47de-8353-00e82a606f0b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.271904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.281060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.281664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.282495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.282768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.283484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=4fd9346df56842ec95720f6d4e859559) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:07.283792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.284322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6108f6-acfa-45c3-8aa4-435fa548feb6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.285245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.300455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 336/674] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/role_assignments?user.id=4fd9346df56842ec95720f6d4e859559&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:07.300455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.325877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.326619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.326894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.327311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.328372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:07.329220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.331128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.347352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 339/675] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:07.348335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.412659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.426391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37933bd1-4d00-402f-b117-8b6f66d76147 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.465173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.465829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.466109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.466379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.473994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de2412-640a-42cd-9a28-4d7f540a142f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.513807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.514817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.515090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.515808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.517128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=8ee82cc4136a4b23aeaf4e115fe7bd5a) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:07.517437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.519221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.527081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 340/676] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/role_assignments?user.id=8ee82cc4136a4b23aeaf4e115fe7bd5a&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:07.527730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.546718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.549086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.551183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.703093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 337/677] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:07.709369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.720435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0a849-9780-476c-901c-2651836e4840 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.740705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.772273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.773154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.774010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.774433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.785196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.787432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:07.803580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:07.804621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:07.805578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 341/678] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:07.808997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.837142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:07.847525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277bea9-92fa-4dd4-ae84-5cb6d89365be None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.890872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.892188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.892421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.892691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:07.904317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:07.905964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:07.921014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:07.921994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:07.923452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:07.923452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:07.923452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:07.923452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 338/679] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:07.929508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:07.956360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658892b-2c9d-414d-9736-95b43a9c112e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:07.997352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:07.998339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:07.998803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:07.999247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.001191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:08.001695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.003309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8a259-cad4-4979-8959-c0b24139c99c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.021530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 342/680] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:08.023081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afb08-86e2-4b15-a361-55bef499e434 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.023650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afb08-86e2-4b15-a361-55bef499e434 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.024152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4afb08-86e2-4b15-a361-55bef499e434 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.025794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 343/681] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:08.033875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.034160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.034437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.057104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:08.058644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:08.061231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eaddb-7dd8-42fa-a61c-6f895518c0e8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.093508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.102788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.103397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.103676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.103950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.104722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:08.105057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.106630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.126436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 339/682] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:08.126436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.127683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.151193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 344/683] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:08.152526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.294698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314f640-46d6-45d4-b04d-3fbb059f0fe6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.317719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e76ac-48fd-4a49-a138-b9912338e303 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.352309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.353264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.353769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.354244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.404846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.405852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.406358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.407404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.425111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.426881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.434960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.436857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.439641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:08.450714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:08.451665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:08.452635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:08.455021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 345/684] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:08.456005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.486720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.553654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 340/685] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:08.554907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.590085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad287-781a-4f5d-9006-058a0aa5450d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.643024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.643648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.643928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.644225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.659236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:08.663931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:08.664871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:08.665733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:08.667012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 346/686] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:08.667603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.670003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bdbf8-d945-4bc3-9405-62d32f33667d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.677506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.720020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.721007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.721759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.722228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.723367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:08.724401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.726304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.745431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 341/687] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:08.745431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.772842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.794563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d7556-c9a2-43d2-8945-c573f8d7aad2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.831588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.832421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.832800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.833172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.845611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.847258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:08.862972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:08.864186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:08.865270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:08.865270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:08.865270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:08.866651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 347/688] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:08.867629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.878169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65737f-0bfb-4318-ad62-b1df6308471a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:08.915754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:08.916599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:08.916986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:08.917358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:08.918129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:08.918534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:08.920079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:08.929343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 342/689] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:08.930195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:08.959501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:08.997102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccf0c2-bacc-42fc-95ae-cda8c7d7fc68 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.036570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.037604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.038320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.038909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.039947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=2be1be9e39a74168887220f2a4cc20d5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:09.040495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.042420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.044605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.050269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72768deb-ca48-4268-977b-ba1c5d27ebba None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.051797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 348/690] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/role_assignments?user.id=2be1be9e39a74168887220f2a4cc20d5&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:09.052861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.103985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.104549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.104824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.105110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.105752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:09.106046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.112659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.140719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 343/691] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:09.147194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.251580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629ffb-aa77-4b51-bdcf-c5ebf4e565bf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.287685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.299388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b39834-94d2-45ef-b4f1-66e6bd8d3b17 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.299623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.300477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.300821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.301156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.322228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.323726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:09.338944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:09.339922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:09.340850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:09.340850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:09.340850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:09.340850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 349/692] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:09.346212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.351375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.352030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.352348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.352623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.362567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.364065 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:09.377805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:09.380706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:09.381799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 344/693] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:09.392788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.411615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.475399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af64f-9dae-4ec9-b090-0e62027d1f8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.511983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868150f-d6f9-47d4-b7a5-bd27063a4689 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.523967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.524711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.524988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.525257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.525896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:09.526196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.528098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf847-a78c-4cbb-bada-8d1ccafa9717 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.543683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 350/694] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:09.545219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fbf6-9a8b-4096-9092-a554a2de599a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.545504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fbf6-9a8b-4096-9092-a554a2de599a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.545775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5fbf6-9a8b-4096-9092-a554a2de599a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.550610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.551630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 351/695] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:09.552051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.552489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5fbf6-9a8b-4096-9092-a554a2de599a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.552792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.553447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.554316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:09.554771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.556459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d22c-f832-4145-856a-51cee0ad51ba None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.570153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 345/696] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:09.571676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.572204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.572728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.588425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.591944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:09.593474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:09.664582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 346/697] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:09.665853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.693344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5fbf6-9a8b-4096-9092-a554a2de599a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.720599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.778347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228e27-c186-4425-9726-25a613121891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.779786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228e27-c186-4425-9726-25a613121891 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.780320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228e27-c186-4425-9726-25a613121891 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.780795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228e27-c186-4425-9726-25a613121891 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.799816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228e27-c186-4425-9726-25a613121891 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.801579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228e27-c186-4425-9726-25a613121891 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f4228e27-c186-4425-9726-25a613121891 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:09.829561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:09.830567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:09.831524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 352/698] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:09.836288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228e27-c186-4425-9726-25a613121891 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:09.853516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c212d-7440-4dfa-a952-b9bb52a69468 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:09.891616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:09.893060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.893543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.894014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.894934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=c47af3f28f044f68a90e6a78ee3102a6) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:09.895445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:09.897247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20f4ea-9a90-4479-82d2-a69cce5a6222 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:09.900819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:09.906209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 347/699] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/role_assignments?user.id=c47af3f28f044f68a90e6a78ee3102a6&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:09.908342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d040b-8d7d-476a-b0d5-ad80fe6e887a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.908863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d040b-8d7d-476a-b0d5-ad80fe6e887a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.909360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d040b-8d7d-476a-b0d5-ad80fe6e887a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.911158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 348/700] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:09.916544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:09.916778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:09.917053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:09.953666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:09.954888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:09.971165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228e27-c186-4425-9726-25a613121891 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.029401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.030255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.030639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.031014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.032402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:10.033260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.035073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.051641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 349/701] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:28:10.052915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.059465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 353/702] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:10.064563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.109061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.179017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faf345-a80c-4ad0-a41a-53b5933e2827 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.186422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113e45-3683-495a-b06a-0c35b0b0be0b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.210244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.217684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.218439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.218817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.219237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.220688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.222071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.225788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.226657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.227229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.227707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:10.233040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:10.234135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:10.235105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 350/703] 10.222.0.73 () {56 vars in 1129 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:10.240198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.303095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.304936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.333927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.349727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d0295-8d5d-4377-97ac-cc44c3394750 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.393552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.394276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.394560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.394835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.395462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:10.395877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.397330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.403550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 351/704] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:10.404393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.424113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 354/705] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:28:10.425287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.475513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.535106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf12a7-d792-43e4-b09a-1e309da94199 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.545715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022266a-5c4b-4d4d-89f1-03d519acfcd6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.577101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.578265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.579368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.579476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.580285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.589672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.590363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.590715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.591083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.592312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:10.592692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.594115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.594524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.596242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.604137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 355/706] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:10.605227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:10.626922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:10.628011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:10.628996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:10.628996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:10.628996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:10.631076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 352/707] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:10.649510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.812222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7a958-6b3f-4f95-85fb-27b1420175a6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.831104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd3984-5649-4e24-8bc8-ab4c88c72c78 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:10.843623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:10.855648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.856591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.857016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.857462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.877274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:10.877892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:10.878172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:10.878697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:10.879321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:10.879629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.881780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:10.883214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.885085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:10.907373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:10.908416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:10.909313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:10.909313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:10.909313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:10.911046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 353/709] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:10.911477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 356/709] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:10.917176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:10.932091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:11.009269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:11.070331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6f11-5bc2-42a6-a718-e9bf336f7881 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.106634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.107741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.108270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.108734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.109524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.110654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0bd4f-2bf4-4163-a1e8-48895d9e757b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.112033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.138895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 357/710] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:28:10 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:28:11.185544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.186172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.186454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.186731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.187383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:11.187689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.197588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82381ba-41f9-4ca7-aae7-81e1d98ca407 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.222178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 354/711] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:11.228195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:11.278818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961c92-d480-402d-a91a-12fd7dae0acf None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.279013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961c92-d480-402d-a91a-12fd7dae0acf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.279291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961c92-d480-402d-a91a-12fd7dae0acf None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.281395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 355/712] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:11.286594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.286905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.287141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.318091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:11.319429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:11.357534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02056aac-a0bd-48c9-883f-2ada7f541cc8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.358525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:11.360917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:11.401911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.402553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.402835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.403098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.411474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.413232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.415739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 356/713] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:11.425736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:11.426682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:11.427631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:11.430047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 358/714] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:11.435811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:11.536914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251afbb-414f-4c72-a3fa-802f210cd7fc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.574368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.575358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.575839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.576348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.577230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:11.577733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.579397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.591530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 357/715] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:11.598199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:11.700555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e51df-c63d-4ea0-98ac-28d0ea099c6c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.702246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:11.740278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:11.741180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.742685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.742685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.742685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.743109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:11.743394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.744839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.751230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 359/716] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:11 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:11.913911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac5b3-5511-4c9f-b773-541889a17920 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:11.960510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:11.961161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:11.961445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:11.961722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:11.962311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:11.963681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:11.977767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:11.978831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:11.979708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 358/717] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:11 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:11.985673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:12.030056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:12.109375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617e523-627b-4ced-8a83-de4979285c52 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:12.151599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:12.152241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:12.152536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:12.152800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:12.153428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:12.153783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:12.155148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a70515-40ec-4355-b94f-762895c473a8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:12.160460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 360/718] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:12.165777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:12.315892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:12.339039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ecde0-ed1d-458b-a142-f3c00df6c2e6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:12.387158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:12.387784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:12.388049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:12.388350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:12.388979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] RBAC: Adding query filter params (type=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:12.389283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:12.390647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b5a2f-2e41-4aa8-ade9-fe822421cd25 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:12.400902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 359/719] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:12.483968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c98ca-728f-4489-9805-1ad49c6a5e40 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:12.484193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c98ca-728f-4489-9805-1ad49c6a5e40 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:12.484512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c98ca-728f-4489-9805-1ad49c6a5e40 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:12.486339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 361/720] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:12.491963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e36c-c0f5-426f-bbf8-1e945903d860 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:12.492292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e36c-c0f5-426f-bbf8-1e945903d860 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:12.492573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e36c-c0f5-426f-bbf8-1e945903d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:12.521315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-aa18e36c-c0f5-426f-bbf8-1e945903d860 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:12.522569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa18e36c-c0f5-426f-bbf8-1e945903d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:12.607021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 360/721] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:12.899023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c98ca-728f-4489-9805-1ad49c6a5e40 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.045558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:13.067226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c98ca-728f-4489-9805-1ad49c6a5e40 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.094008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3afc-a940-43aa-bf49-4805ed6452fb None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.094609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3afc-a940-43aa-bf49-4805ed6452fb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.094609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a3afc-a940-43aa-bf49-4805ed6452fb None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.095950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 361/722] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:13.106403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.107084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.107602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.107885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.112683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.112960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.113334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.120749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:13.126782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:13.127796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:13.128696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 362/723] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:13.134568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.158431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:13.159553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:13.283931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 362/724] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:28:13.298055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ec965-ae48-460a-856e-95378c8a4aa0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.339286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.339898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.340209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.340486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.341149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:13.341452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:13.342813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:13.355471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 363/725] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:13.361613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.374315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:13.497288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5676-afa0-427c-84dc-10ff1e02db02 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.550114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.550751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.551036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.551311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.567641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:13.569134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:13.587179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:13.588190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:13.589099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:13.589099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:13.589099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:13.589099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 363/726] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:13.594767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.612110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:13.692386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.719627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb5ea4-82ee-40e2-922f-49df74a0f355 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.788930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.789465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.789751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.790024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.790669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:13.790973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:13.792430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:13.799615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:13.805934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 364/727] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:13.811316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:13.888424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:13.916872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b393a-618b-4602-bde1-1d7aff77bb14 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.921914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4a9d5-1019-46eb-853a-a4f35c77dfeb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:13.956193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.956835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.957115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.957386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.958036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:13.959637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66b0e-f4eb-4f94-97dd-e6473bcdcf3a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:13.968318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:13.969032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.969972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.970359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.978146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:13.978580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 364/728] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:13 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:28:13.980091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dcb5-ec1f-4509-88cf-ef87eb0f82b6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.980535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dcb5-ec1f-4509-88cf-ef87eb0f82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.981039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dcb5-ec1f-4509-88cf-ef87eb0f82b6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:13.986921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:13.987218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 365/729] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:13.988958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b2813-d827-4864-a90d-d3cf23949617 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:13.989435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b2813-d827-4864-a90d-d3cf23949617 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:13.989897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b2813-d827-4864-a90d-d3cf23949617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.009746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cb3b2813-d827-4864-a90d-d3cf23949617 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:14.011287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cb3b2813-d827-4864-a90d-d3cf23949617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:14.011694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:14.012679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:14.013642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 365/730] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:14.020177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.122890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 366/731] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:14.125492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa45d-911b-4cde-bf69-e66217ed9f84 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.125778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa45d-911b-4cde-bf69-e66217ed9f84 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.126048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa45d-911b-4cde-bf69-e66217ed9f84 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.127585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 367/732] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:14.136080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.136080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.136080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.154318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:14.158023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:14.190185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c1c1-00c0-4fac-b3bc-3367f0387c08 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.208795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.230346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.237661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.238333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.238614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.238890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.239672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:14.239984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:14.241476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:14.243506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 368/733] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:14.260899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 366/734] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:14.267106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.373127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08967cd2-03b4-4776-8f77-dc1a1c222e8c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.412361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.412975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.413256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.413530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.460566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.484219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:14.485709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:14.496554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.621760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109eed-0977-4cc2-ab2f-25b2ed1c5044 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.641894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 369/735] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:28:14.643059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.658588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.659226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.659502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.659772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.670269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:14.675611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:14.676621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:14.677498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 367/736] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:14.678204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.736405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.738837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.761123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9d2bf-3fc6-4f1c-b251-4849050d70af None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.790729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007e958-f8f5-4a40-95f9-56adf23f6b2c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.795920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.796811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.797907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.798375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.809296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:14.815370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:14.816332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:14.817169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:14.819833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 370/737] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:14.820856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.830764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.831506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.831690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.831926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.842293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:14.843729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:14.859011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:14.860605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:14.861501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:14.861501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:14.861501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:14.861501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 368/738] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:14.861738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:14.936665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9056b-740d-46f6-9bc7-f8a09bf6c31d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.973530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:14.974127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:14.974397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:14.974668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:14.975310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:14.975609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:14.976434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.977046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:14.979469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:14.980269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078088c-6a80-4675-94e3-d68f900ea8ad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:14.991812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 371/739] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:14.992567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.020645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.021247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.021532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.021807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.022465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:15.022772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.024146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c4f79-43c2-47c5-92d4-1eaf381ad9ae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.033870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 369/740] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:15.035024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbb18f-4ce3-47b2-a612-a69c4e3b8a44 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.035308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbb18f-4ce3-47b2-a612-a69c4e3b8a44 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.035581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbb18f-4ce3-47b2-a612-a69c4e3b8a44 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.040870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 370/741] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:15.041624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbb18f-4ce3-47b2-a612-a69c4e3b8a44 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.101742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2d96d-8f84-4ae6-b486-1d83346039e6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.137877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.139256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.139736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.140186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.141623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:15.141948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.143313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.149236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbb18f-4ce3-47b2-a612-a69c4e3b8a44 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.160020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 372/742] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:15.161574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.185041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.185666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.186280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.186280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.196776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.198128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-73fdb977-6af3-4111-bfae-acb16dde6389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:15.215185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:15.216194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:15.217091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:15.217091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:15.217091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:15.217091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 371/743] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:15.217736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.217842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.218052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.231289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.236279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:15.237503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:15.247204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.280191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacccfd6-45bf-434d-b063-f5bc60cabb6c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.311684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 372/744] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:28:15.312553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.325754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.326925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.327446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.328393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.343572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.346021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:15.367917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:15.368924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:15.369843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:15.369843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:15.369843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:15.376978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 373/745] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:15.376978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.423252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f9f00-4067-4980-83f6-7035d22d0182 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.461372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.462314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.462794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.463528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.472542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.474754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:15.488387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:15.489358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:15.490276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:15.494235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 373/746] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:15.495130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.499385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.508944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4287045-56dd-47aa-aee3-b17162a0e1ea None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.523886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.556768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.557897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.558613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.559066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.560323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:15.561068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.563834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.578837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 374/747] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:15.579897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.606994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cf34f-25fd-4487-897c-62ebcbc1ea96 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.646542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.647151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.647435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.647710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.648381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:15.648739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.650133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.667282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 374/748] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:15.667282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.687582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ff6d-56c3-4eea-8653-e0bc2710436d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.729446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.729982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.730266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.730543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.731237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:15.731852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.732994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.738005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.746327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 375/749] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:15.747029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.780995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:15.784553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe08cbd-9e71-4120-8608-457f57f45515 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.820828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.821437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.821720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.822013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.822609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.824639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.848110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 375/750] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:15 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:15.848110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.863971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d004a-a5df-4660-b49f-c4cc118171ef None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:15.907074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:15.907736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:15.908088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:15.908397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:15.917978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:15.919448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:15.934884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:15.935939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:15.936916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 376/751] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:15.937524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:15.989134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb313-fa6a-4e18-96c0-d43df0269d2c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.024098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.035722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.039879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.039879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.039879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.040343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.052785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.054777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.055105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02dad-00ee-4d33-993e-7c026672d1e5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:16.069493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:16.070492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:16.071452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:16.073452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 376/752] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:16.074156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.103305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.104507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.105227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.105698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.107367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=c47af3f28f044f68a90e6a78ee3102a6) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:16.108114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.111270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.124085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 377/753] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:15 2022] GET /identity/v3/role_assignments?user.id=c47af3f28f044f68a90e6a78ee3102a6&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:16.124085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.204688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8577-766e-4e5c-bf3c-eb7c2a504dec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.243901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.244922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.245424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.245917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.247000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:16.247520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.249210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a4675-1348-405f-b09c-02285a61a66d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.264646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf161bdb-e5cd-49ac-a14a-7eeb25a45334 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.271522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 377/754] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:16.273213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d006-0d30-4d3e-9126-6892f322220d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.273721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d006-0d30-4d3e-9126-6892f322220d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.274199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762d006-0d30-4d3e-9126-6892f322220d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.276028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 378/755] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:16.276973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762d006-0d30-4d3e-9126-6892f322220d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.307399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.308017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.308371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.308642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.309553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:16.309861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.311942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2585d9-dfee-4af4-8036-7a0c6e0a1af7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.333668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 378/756] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:16.335014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.335302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.335579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.342967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.356913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:16.358143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:16.360477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.423879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762d006-0d30-4d3e-9126-6892f322220d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.432317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 379/757] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:16.433528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.463908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.465081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.465820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.466285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.542203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.543969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.633583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.639913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd145f79-f167-41a5-ba31-f253c0bedb6e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.679319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.681393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.682072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.683114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.695746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.704232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.707550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:16.736490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:16.737427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:16.738312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:16.738312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:16.738312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:16.741956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 380/758] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:16.748459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.751827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 379/759] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:28:16.752893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.875669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261d589-0f6c-42b7-8289-759a6272faea None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.893694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63dd4-0998-4fa0-8738-6c540e489d42 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:16.918404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.919280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.919697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.920192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.930644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.932409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.934389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:16.936580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:16.937217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:16.937500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:16.937776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:16.938513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:16.938882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:16.940330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:16.950509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:16.951668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:16.952683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:16.952683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:16.952683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:16.954872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 380/760] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:16.955771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:16.959984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 381/761] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:16.966169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.034692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.091314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e717a-8fc9-47e1-bf11-c26cf39063e0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.094727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e36bc-0ae8-46ea-949e-8e27664b3e92 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.135101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.135952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.136415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.136785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.137014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.137468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.137763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.138172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.138759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.140317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.145821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.147662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:17.153544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:17.154698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:17.155742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 381/762] 10.222.0.73 () {56 vars in 1129 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:17.156642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:17.166020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:17.167088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:17.167997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:17.170486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 382/763] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:17.171910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.233448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.295621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1582f3-7ccf-4b18-9b1b-4767d64e11cf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.312013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b542ec-9cfa-43e5-8673-04d1f7318867 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.325057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.338764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.339379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.339923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.340231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.341288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:17.341603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.343235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.352368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.353136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.353578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.354068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.354820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:17.355272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.356865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.361714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 382/764] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:17.361714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.367107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 383/765] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:17.368102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.480340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe7497-9899-45c5-b89e-72c94d2eac02 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.494183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb46f-4ad9-44b3-8410-08575808577b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.516772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.523504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.524168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.524468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.524979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.534831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.536589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.536869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.537622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.538053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.538475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.539344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:17.539791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.541389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:17.548649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:17.549713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:17.550704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:17.557091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 383/767] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:17.557091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.557411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 384/767] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:17.559361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.597826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.682797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c701-6534-4926-8e05-1eb72d6ae635 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.733710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.734350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.735159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.735449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.736131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:17.736439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.737842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.748390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 384/768] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:17.749358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.790334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704b8bc-304b-4290-a598-514f7596a432 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.802974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.839042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.839657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.839964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.840689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.841391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:17.841699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.843802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.864099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 385/769] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:17.864099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.871494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d0fd-5065-4e18-a1f7-70240356894f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:17.910774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:17.911990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:17.912484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:17.913140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:17.916197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=92d15db5127347b8b25cdf41abb2ab07, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:17.918192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:17.932087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 385/770] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:17 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:17.932890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:17.977921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:17.989222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784cbbb-19fa-490c-a34d-e94d832e1f56 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.040742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.041899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.042330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.043271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.044500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] RBAC: Adding query filter params (interface=public, service_id=ba1ae6f521594e07b79e212207dfcf91, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:18.044968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:18.047355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa052e16-2fae-4fea-848f-7f77b2755124 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:18.053129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407be3b-5db5-4379-9914-601c1644f73e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.055064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:18.066559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 386/771] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/endpoints?service_id=ba1ae6f521594e07b79e212207dfcf91&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:18.068884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166465-b55a-435c-9291-dfb44bd13b1d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.069322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166465-b55a-435c-9291-dfb44bd13b1d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.069739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166465-b55a-435c-9291-dfb44bd13b1d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.072191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 387/772] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:18.073328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166465-b55a-435c-9291-dfb44bd13b1d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:18.101916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.102708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.103091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.103476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.104351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=77b45502aefb42cbaaa7cc4d3f63f406) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:18.104764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:18.106295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231d1e-8ae8-4b72-a1f1-14f23ab14ac1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:18.113833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 386/773] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:17 2022] GET /identity/v3/role_assignments?user.id=77b45502aefb42cbaaa7cc4d3f63f406&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:18.115061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cbbe-17f4-4837-a758-73c83bc388b7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.115445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cbbe-17f4-4837-a758-73c83bc388b7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.115815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3cbbe-17f4-4837-a758-73c83bc388b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.135085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-86c3cbbe-17f4-4837-a758-73c83bc388b7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:18.136533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-86c3cbbe-17f4-4837-a758-73c83bc388b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:18.205053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166465-b55a-435c-9291-dfb44bd13b1d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.222249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 387/774] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:18.223789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd904f-ff7b-48c4-89d7-f1723efeab9b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.224295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd904f-ff7b-48c4-89d7-f1723efeab9b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.224702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd904f-ff7b-48c4-89d7-f1723efeab9b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.230203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 388/775] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:18.232718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.233182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.233580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.260170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:18.260170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:18.271423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.272332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.272712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.273116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.276778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:18.278401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:18.290088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 388/776] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:18.360222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 389/777] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:18.504044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:18.529190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:18.613169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908aa7c-1bf9-40f2-ba6d-bc5bf0c55c47 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.658775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.659425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.659709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.659986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] PATH_INFO: `/v3/services/network` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.660607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:18.661977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:18.674211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:18.675097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:18.676111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:18.676988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 389/778] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:18.684098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:18.722682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:18.832508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:18.848963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf063057-e788-49b3-ab74-016497d5cb13 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.863049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ac9e1-145d-427b-a640-ecd0e92fe81d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:18.914333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.914946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.915228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.915502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.916157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:18.916461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:18.917840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:18.926462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:18.927099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:18.927380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:18.927650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:18.936136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 390/779] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:18.940821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:18.945100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:18.950008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:18.950931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:18.951784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 390/780] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:18.961413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.082003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34c88-a849-41a2-9c5d-12e05727c4c5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.143663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:19.149284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.149895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.150168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.150433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.151059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] RBAC: Adding query filter params (type=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:19.151353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.152729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.156429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122453-3383-4b79-8f4b-6ba392a2632c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.170855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 391/781] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:19.176189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.201067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:19.221094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.221701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.221976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.222242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.222896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:19.223195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.224599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.254289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 391/782] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:19.255271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.366269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d58994-1b1d-4d37-999e-1e7edb48cbff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.372290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfca8a-5e7a-4f57-b06d-8f9e22770c48 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.404166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.404726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.405000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.405266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.416581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.418106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:19.431966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:19.432943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:19.433829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:19.433829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:19.433829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:19.433829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:19.437698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 392/783] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:19.439079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.472764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.473388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.473672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.473950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.474664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] RBAC: Adding query filter params (interface=public, service_id=4cc7b3f53210474a8c69f2053b825d37, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:19.474974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.476369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.484224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 392/784] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/endpoints?service_id=4cc7b3f53210474a8c69f2053b825d37&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:19.497010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.568210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326d6d6-9c4a-41c1-bb70-ad2badd7bbdb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.632936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.633543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.633828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.634094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.634726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:19.635032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.636417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.658414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 393/785] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:19.659592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.668534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:19.700809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbb347-13b4-4407-b030-f228ffbabbfc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.719360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:19.762452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544770-a165-4fe5-a902-d6cf271eb8fa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:19.772414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.773040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.773323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.773599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.774212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.775592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.787854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 393/786] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/services => generated 772 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:19.798596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:19.799261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:19.799538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:19.799804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:19.808198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:19.809670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:19.822928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:19.823940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:19.824938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:19.828180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 394/787] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:19.833217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:19.985526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe90bf-6180-4668-8a44-5e69c8a2ee42 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.026309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.026915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.027189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.027462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.028210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:20.028512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:20.029931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424b0f9-1d44-4a0b-bdf6-acf3f7645cf1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:20.044505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.052167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 394/788] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:28:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:20.055214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.057302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d647-5a2a-4f78-9657-3b09fe8727ed None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.057580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d647-5a2a-4f78-9657-3b09fe8727ed None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.057855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d647-5a2a-4f78-9657-3b09fe8727ed None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.059706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 395/789] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:20.073291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.073586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.073835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.092228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:20.093676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:20.167490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 396/790] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:20.182349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3246882-d315-4782-83d3-a945240071d1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.203169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.223520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.224239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.224516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.224784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.239618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:20.241027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-540be0d0-4e69-4f38-bd66-0d96d2593a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:20.263231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:20.264670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:20.266072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:20.266072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:20.266072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:20.268872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 395/791] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:20.274562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.289467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ca73-5c81-42ea-8b5f-4a830889ac0e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.289761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ca73-5c81-42ea-8b5f-4a830889ac0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.290010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10ca73-5c81-42ea-8b5f-4a830889ac0e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.291443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 396/792] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:20.296584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.297196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.298154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.316713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:20.318274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:20.438353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 397/793] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:20.453920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994fb3d-50ff-47e5-a39f-3f853b298ac6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.498264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.505526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.506130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.506403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.506669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.507310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:20.507608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:20.509068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.520599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:20.543298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 397/794] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:20.549621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.622083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021ce3-a9ab-46bd-965e-46762705d0c8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.623543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.661282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.661935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.662349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.662627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.673621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:20.678832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:20.679753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:20.681673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 398/795] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:20.685801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.772351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f095-2e6f-4086-b804-1371c7bbbc76 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.799865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d001-c585-4dc7-97c5-4f6817db3a89 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.814133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.815099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.815407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.815686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.823759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:20.825716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:20.839643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:20.840395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:20.841267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:20.842163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:20.843288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:20.843765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:20.844829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:20.845700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:20.846199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:20.846885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 398/796] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:20.847738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.848340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:20.858155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 399/797] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:20.859464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:20.888870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.914394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:20.977775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb26cf-71bf-4e12-a709-5528ff0a35ae None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:20.984226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1247-b4dd-43d2-abfa-197d23745c5b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.014256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.014866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.015145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.015416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.016663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:21.016967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.018398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.023042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.023615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.023956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.024267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.031057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 400/798] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:21.032480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.040211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3b0850ff-f235-4446-b762-3471931a0876 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:21.045428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:21.046351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:21.047836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 399/799] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:21.048585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eda21-afd2-4767-9e25-75e3aa97ab17 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.048585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eda21-afd2-4767-9e25-75e3aa97ab17 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.048721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371eda21-afd2-4767-9e25-75e3aa97ab17 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.049983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 400/800] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:21.050510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eda21-afd2-4767-9e25-75e3aa97ab17 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.136214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.158090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3d9a-01b2-490b-90c8-dca72910c4c1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.167543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371eda21-afd2-4767-9e25-75e3aa97ab17 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.179097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.193927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.194559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.194838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.195110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.205025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65713b40-1474-495d-a415-628a472aa56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.205634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.205756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65713b40-1474-495d-a415-628a472aa56c None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.205926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65713b40-1474-495d-a415-628a472aa56c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.206196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65713b40-1474-495d-a415-628a472aa56c None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/c47af3f28f044f68a90e6a78ee3102a6/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.207074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.208165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65713b40-1474-495d-a415-628a472aa56c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=c47af3f28f044f68a90e6a78ee3102a6, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.209567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65713b40-1474-495d-a415-628a472aa56c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.223521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 401/801] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:21 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/c47af3f28f044f68a90e6a78ee3102a6/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b6cea8c0-4962-49e4-961d-7be406157f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:21.223776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:21.224854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:21.225761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:21.225761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:21.225761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:21.230073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 401/802] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:21.231485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.231765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.232039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.237021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65713b40-1474-495d-a415-628a472aa56c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.268681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:21.270013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:21.356632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 402/803] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:21.357557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.394118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65713b40-1474-495d-a415-628a472aa56c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.437187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.437829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.438111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.438382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.439049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:21.439569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.441280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.450205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 402/804] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:21.456211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.458556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.493244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.511115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078b386-69e0-47e8-8d8c-21d16ae74806 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.552533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.553249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.553646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.554009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.554772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:21.555413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.556649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.569086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 403/805] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:21.576081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.591494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189568b-768d-4ab8-a329-ededdee9f932 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.632668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.633302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.633509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.633784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.644998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.646549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:21.662134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:21.663148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:21.664050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:21.664050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:21.664050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:21.664050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 403/806] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:21.669068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.748081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12347-d2f7-4600-9e35-29894ab582c1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.760758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.776271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:21.777818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114306a-06a4-4b05-9c7c-6fcdc8e5414d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.787874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.788798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.789298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.789771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.797918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.799661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:21.811469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:21.812440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:21.813958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:21.815060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.815670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.815950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.816252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.816982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:21.817290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.817977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 404/807] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:21.818784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.819169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.832914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 404/808] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:21.838168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:21.931404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67499ca-78a4-415b-89db-e4bfa8e57f6e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.946404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b0c5d-413f-4ff6-8de2-483a9b4169c2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:21.971257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.972449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.972961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.973428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.974223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.975987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.983450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:21.984204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:21.984486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:21.984829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:21.985557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:21.985865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:21.987010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:21.987998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:28:21.988880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:21.989627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:21.996306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 405/809] 10.222.0.73 () {56 vars in 1129 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:21.997381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.006666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 405/810] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:22.007666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.010637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.120564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8dd5a-9aa4-42e8-9ff0-f19ec8e5b4c8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.157152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.157753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.158028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.158299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.158938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:22.159223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.160616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.169675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 406/811] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:22.169675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.172834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.226284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f787ec-6992-4ffe-8c58-ad610f06fdf4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.235419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.263129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.264108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.264527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.264964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.272190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.273626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.277482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240e6b5-ab8f-4aad-80f4-4ebec9a3deb6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b776eac2-46e6-425f-a81b-3e16ff707648 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:22.285039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:22.286005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:22.286942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 406/812] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:22.288026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948172dd-1f60-4323-8394-2562b5a15ed1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.288026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948172dd-1f60-4323-8394-2562b5a15ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.288234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948172dd-1f60-4323-8394-2562b5a15ed1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.292100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 407/813] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:22.292100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948172dd-1f60-4323-8394-2562b5a15ed1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.321637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.322358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.322643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.322915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.395588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.397216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0633f-a22c-4860-9cad-a0a1e0f3e486 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.400934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948172dd-1f60-4323-8394-2562b5a15ed1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.412839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.439546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.440177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.440456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.440726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.441349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:22.441820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.443231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.447972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 408/814] 10.222.0.73 () {56 vars in 1124 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:22.448771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.470899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.512802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 407/815] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:28:22.514375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.514663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.514939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.533206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:22.534403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:22.563707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37052bf-c0f6-470a-993e-eb3837472fca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.597951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.598567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.598850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.599124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.599848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:22.600197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.601613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.604387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 408/816] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:22.605387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.624345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 409/817] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:22.625765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.659049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.734353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.742494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb0f01-e0bc-4ade-bbf0-841adeefcab6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.746684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42998a31-cac3-487f-91cd-0052c4ba8857 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.779270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.780580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.781077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.782086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.782947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.784685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.789764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.790687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.790966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.791237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.804017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.805689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.811647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 409/818] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:22.813039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:22.821142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:22.822215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:22.823787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:22.823787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:22.823787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:22.823787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 410/819] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:22.827831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:22.924760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:22.942904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4812e6-bbaa-4448-89f8-656c6dbb66d5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.943241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951fa8-60ef-458b-85c6-cc317e8a846f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:22.982671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.983322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.983601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.983877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.986825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:22.987806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:22.988317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:22.988782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:22.989645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:22.990157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.991761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:22.997026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:22.998510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.010943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 411/820] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.010943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:23.020179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:23.021178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:23.022071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:23.022071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:23.022071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:23.022071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.022071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 410/821] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:23.028665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.129407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a52db-9feb-4d64-a853-207dc50d4592 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.159456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136140-4807-431e-9803-567c9ddfe850 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.171514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.172631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.173136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.173598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.174368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.175920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:23.184935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:23.185922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:28:23.186757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:23.189490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 412/822] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:23.190470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.206256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.206447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.207447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.207801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.208146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.218214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.220857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:23.235617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:23.236572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 411/823] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:23.237480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.311720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.312595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1b97-8e82-44a1-ae1e-2ff0298d8f21 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.350995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.351743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.352091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.352438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.353150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.353514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.354940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.357090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c48954-d78a-4be7-9e92-5ce711d325de None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.366944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 413/824] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.367851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.397754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.398363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.398642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.398913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.399533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] RBAC: Adding query filter params (name=network) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.399833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.401254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2195d1-0577-4857-8e21-eecf5fd5f890 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 412/825] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9bb2b-5d19-4030-a078-0043ac9b8bce None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9bb2b-5d19-4030-a078-0043ac9b8bce None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9bb2b-5d19-4030-a078-0043ac9b8bce None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 413/826] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:23.412332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9bb2b-5d19-4030-a078-0043ac9b8bce None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.440390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.474767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d6c48-4d6b-433e-a0b1-40568d6e509d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.510649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.511545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.511820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.512112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.512802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.513114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.514513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.525221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9bb2b-5d19-4030-a078-0043ac9b8bce None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.526197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 414/827] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.526980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.550568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.561969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.563299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.563757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.564028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.570954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.572536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e3557586-cbac-4f53-b2c0-446f088e02e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:23.584994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:23.586068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:23.586974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 414/828] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:23.587564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.587795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.588088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.606003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:23.607292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:23.637028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103354f8-5583-4f4e-94e2-a1ff99dd093d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.663945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.673340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.673939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.674216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.674484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.675132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] RBAC: Adding query filter params (type=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.675434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.676804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.679452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 415/829] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:23.680499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.686851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 415/830] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.687547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.787983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638e1c8-16aa-49f4-acf6-e423ea1ef930 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.793096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99bc30-2f33-4506-9a58-b20829d3fcbe None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.808607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.825132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.825744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.826019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.826282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.827063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.827365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.828945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.832319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.833143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.833631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.834096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.835024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:23.835541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.837312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:23.841278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 416/831] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.842430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.844523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 416/832] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:23 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:23.858928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:23.900603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:23.952467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1123f-3a20-4299-81d9-6351d089d6fc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:23.992160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:23.993544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:23.994287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:23.994741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:23.995776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:23.998180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.026987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 417/833] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:24.028190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.050517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c3a20-6007-41a9-83c7-8f2e90a47cc7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.118832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.120186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.120843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.121393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/77b45502aefb42cbaaa7cc4d3f63f406/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.145343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=77b45502aefb42cbaaa7cc4d3f63f406, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:24.147576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.165994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 417/834] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:23 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/77b45502aefb42cbaaa7cc4d3f63f406/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:24.190580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c377f-b372-4795-bfda-769f6e9fef17 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.202585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:24.239591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.240710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.240989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.241259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.258243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:24.263670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:24.264729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:24.265596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 418/835] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:24.271667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.299903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:24.379742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbf025-1ec3-46f8-bcce-508db1ce5f12 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.414887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.415498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.415776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.416046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.416744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:24.417042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:24.418405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.427910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 418/836] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:24.433375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.544100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbe07a-9d47-4285-bb68-a012a920d83d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.584334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.585315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.585797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.586283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.602749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:24.604228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:24.619116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:24.620105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:24.620992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:24.620992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:24.620992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:24.620992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 419/837] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:24.627069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.714789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:24.732089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7bc6f-8a7d-488f-bd07-a394d14d1c48 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.766583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.767190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.767469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.767795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.768531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:24.768833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:24.770246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.782686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 419/838] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:24.788166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.811306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:24.892629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a8cbc-c323-429e-b38f-e3a5524953f1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:24.926802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:24.927430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.927706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.927974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.935567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:24.937009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e0e69862-7220-4d2d-916a-ec27c3548068 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:24.947941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:24.948897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:24.951066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 420/839] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:24.955090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:24.967900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8599b2-a51a-4b73-852d-bedd23b25e10 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.968509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8599b2-a51a-4b73-852d-bedd23b25e10 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.969519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8599b2-a51a-4b73-852d-bedd23b25e10 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:24.972147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 421/840] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:24.976351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:24.976866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:24.977341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.001279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:25.003162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:25.074240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0800a9-eda7-45df-b674-a40dd281b0a2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.082843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 422/841] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:25.115014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.115887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.116373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.116941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.117962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:25.118409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.120006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.138706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 420/842] 10.222.0.73 () {56 vars in 1135 bytes} [Thu Aug 18 16:28:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:25.144997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.158091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.246769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8c8b-daa0-492e-a478-fb777c91d476 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.283135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.283747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.284025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.284328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.358833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.360667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.372387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.394846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.398625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.462864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 423/843] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:28:25.468548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.521345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8e88-3fb3-4a7c-8d69-96bd63b109ea None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.568930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.570070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.570528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.571198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.572329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.573848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:25.586636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:25.587876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:25.588953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:25.590679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b89cec-4112-4992-a92e-57da79f12252 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.596424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 421/844] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:25.598076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.612477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.650474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.652117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.652595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.653439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.666323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.668113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.677754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:25.684041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:25.685215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:25.686319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:25.686319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:25.686319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:25.687747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 424/845] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:25.697059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.724764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fea201-236a-4fd1-a4f0-19e5493d2541 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.775139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.776288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.776731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.777748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.778835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:25.779309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.782637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.792890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 422/846] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:25.793571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.820748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94bae5-94e5-4ce0-926b-13c1f7ff2b48 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.864350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.864903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.865184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.865458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.866227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:25.866497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.867878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.885854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 425/847] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:25.887106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:25.916220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.931503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29ecd7-65e0-4490-bcfa-24aadbf04b72 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:25.963600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:25.971067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:25.971678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:25.971957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:25.972270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:25.972973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:25.973279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:25.974702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26a02-05ac-4e27-925c-7280c4a527f4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:25.984555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 423/848] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:26.016990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e42997-152b-4e84-bb23-b7eda285acf8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.056674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.057645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.058104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.058553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.066751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.068583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:26.081670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:26.082629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:26.083537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:26.085763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 426/849] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:26.091222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67fdaf-9949-412c-a063-9a2a11aab665 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.091581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67fdaf-9949-412c-a063-9a2a11aab665 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.091919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67fdaf-9949-412c-a063-9a2a11aab665 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.093044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.093569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 424/850] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:26.099622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00092d0-125a-4605-8576-0bdd6ea8244b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.099911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00092d0-125a-4605-8576-0bdd6ea8244b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.100271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00092d0-125a-4605-8576-0bdd6ea8244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.120909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c00092d0-125a-4605-8576-0bdd6ea8244b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:26.122939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c00092d0-125a-4605-8576-0bdd6ea8244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:26.194375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:26.199847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 425/851] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:26.218525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4399d79-7ca3-4a5f-b454-6eee56ebf085 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.218852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4399d79-7ca3-4a5f-b454-6eee56ebf085 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.219666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4399d79-7ca3-4a5f-b454-6eee56ebf085 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.220350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd50b-8dfb-4164-b6b2-b66c2ab43fff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.224806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 426/852] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:26.226242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.226523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.226797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.244568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:26.246076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:26.259319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.260341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.261162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.261830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.262671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:26.263276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.265179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.286820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 427/853] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:26.288696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.327470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 427/854] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:26.393758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f468182-3270-4f13-8504-91fa5c7cf4e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.429693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.430638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.431125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.431593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.432552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=c47af3f28f044f68a90e6a78ee3102a6) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:26.433059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.434679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.441590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 428/855] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/role_assignments?user.id=c47af3f28f044f68a90e6a78ee3102a6&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:26.467032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.533057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:26.582427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216273f-652b-4f09-b0b9-f05d84fcb691 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.611048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.618385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.619022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.619296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.619562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.620214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.621486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:26.621665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:26.632693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:26.633706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:26.635578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 428/856] 10.222.0.73 () {56 vars in 1132 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:26.639952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.736099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2706dff-4ee8-4107-9327-265624545833 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.764934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55797d-8ff8-499d-a516-13a3fa6786a9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.774910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.775544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.775820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.776119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.787396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:26.790129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:26.793819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:26.794930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:26.795774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 429/857] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:26.802305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.811890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.812657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.813504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.813847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.815012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:26.815388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.817587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.824375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 429/858] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:26.829782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:26.884214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:26.923761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30efad6-7708-4f5f-a3cf-1626dc108082 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.959433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:26.960477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:26.960858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:26.961224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:26.962032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:26.962388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:26.963847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:26.973831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04012f-10c1-4fa2-81f9-348fc0c213e1 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:26.974570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 430/859] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:26.980149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:27.020907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.021449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.021729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.022001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.022629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:27.022930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.024343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.032298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 430/860] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:27.099521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db12ed-b3ed-4e88-a326-7da0c968e954 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:27.130797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:27.140747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.141404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.141688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.141962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.157423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.159334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:27.177862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:27.178902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:27.179814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:27.179814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:27.179814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:27.179814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 431/861] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:27.185082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:27.243043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:27.297893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554901f-add6-407f-82fe-1cf7c9f7ed58 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:27.332970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.334213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.334500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.334777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.335420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:27.335724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.337237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.350715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 431/862] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:27.355998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:27.462548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9db8-7ef9-4d0d-81f3-58e007db19a7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:27.497738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.498730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.499210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.499728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.508351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.510067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:27.522442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:27.523392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:27.524407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:27.527003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 432/863] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:27.533228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:27.641646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48587d41-e16d-4c04-8e35-5002fc77b1b5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:27.651422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:27.680543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.681158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.681439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.681710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.682441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:27.682746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.684191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ce560-106b-4a6d-ac4f-741771771af4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.706928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 432/864] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:27.709121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:27.754664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:27.816840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb4a2-62bb-484d-9a4f-a4e47f0ad2f4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:27.850823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:27.851429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.851712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.851985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.924885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:27.926636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:27.945181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a236-0038-4de4-a6da-4e78c8e54003 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.945482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a236-0038-4de4-a6da-4e78c8e54003 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.945691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4a236-0038-4de4-a6da-4e78c8e54003 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.947244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 433/865] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:27.952475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:27.952755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:27.953022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:27.969797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:27.972221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:27.973353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:28.032927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 433/866] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:28:28.038587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.066219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 434/867] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:28.145895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3ddd6-81c6-4c16-a10c-e0760c6d96aa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.181222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.182081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.182515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.182928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.192429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:28.195346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.196978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:28.212365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:28.213550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:28.214644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:28.214644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:28.214644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:28.220434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 434/868] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:28.222180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.323523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:28.329369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07264be8-32e5-4db0-8fb0-a81ddc77d6e1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.363632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.364269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.364543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.364814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.365440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:28.365736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.367084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.379312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 435/869] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:28.385122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.385247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.494025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04e4c6-ea39-40a8-9c9c-67ddb45a0df1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.516557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330062c-dac8-47c6-965d-504d54dbde60 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.534045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.534670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.534954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.535233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.535877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.537309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167f65-4af8-4632-9a37-12e628f3118a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.552996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 435/870] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:28 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:28.554209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfde9-1b0f-4902-beb5-7f71d3427376 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.554490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfde9-1b0f-4902-beb5-7f71d3427376 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.554760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bfde9-1b0f-4902-beb5-7f71d3427376 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.556127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 436/871] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:28.561535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.561823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.562099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.576896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.578212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.578713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.579184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.582110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:28.583497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:28.590109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.591971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:28.610601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:28.611572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:28.612504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:28.618230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 436/872] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:28.619435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.642545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:28.652201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:28.688480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 437/873] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:28.759539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e303295-f95c-43cc-969b-266b32004747 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.794345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.794952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.795225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.795492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.796210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:28.796496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.798475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.811380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 437/874] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:28.817325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.924270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef62f-8297-414c-8572-86a9c4987e49 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:28.958846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:28.960507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:28.961375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:28.962139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:28.963607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:28.964586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=77b45502aefb42cbaaa7cc4d3f63f406) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:28.965120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:28.966824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8ed87-494e-4157-8d89-f74a2d418a3a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:28.976115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 438/875] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/role_assignments?user.id=77b45502aefb42cbaaa7cc4d3f63f406&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:29.047546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:29.081990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b6b8a-a7f1-4dd6-98a6-646a919cd447 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:29.101070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0082-dacd-4281-b33b-6e8cf337cb92 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.101355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0082-dacd-4281-b33b-6e8cf337cb92 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.101635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0082-dacd-4281-b33b-6e8cf337cb92 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.103335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 439/876] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:29.108887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.109174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.109567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.127099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:29.127754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.128030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.128338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.128927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:29.130374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:29.133495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:29.135002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:29.139982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:29.141546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:29.142392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 438/877] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:29.152850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:29.184848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:29.221066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 440/878] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:29.279788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c1d1b-8a22-4b6e-af27-64fbf04da05d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:29.316508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:29.317352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.317784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.318193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.318953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:29.319393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:29.320913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:29.322933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:29.332133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 439/879] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:29.333219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:29.436417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc315d0-4dd3-4512-a317-af9435ecf443 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:29.470954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:29.471563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.471847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.472162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.472793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:29.473096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:29.475713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4d567-4c7d-4509-916c-3c2f3203e3ec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:29.480640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 441/880] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:29.511685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:29.624436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff23c9-9ae5-4433-b717-68f552497a07 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:29.664010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:29.664674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:29.664948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:29.665255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:29.665915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:29.667263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf707-bb84-4b9c-a3ac-effe013b5220 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:29.683536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 440/881] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:29 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:30.627453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53a00-c38f-466d-a3ae-92ccf36b8037 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:30.627978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53a00-c38f-466d-a3ae-92ccf36b8037 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:30.628085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53a00-c38f-466d-a3ae-92ccf36b8037 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:30.629669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 442/882] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:30.634648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec169a-f814-4013-98b6-69bfef953786 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:30.635446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec169a-f814-4013-98b6-69bfef953786 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:30.635915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec169a-f814-4013-98b6-69bfef953786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:30.655106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-feec169a-f814-4013-98b6-69bfef953786 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:30.657247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-feec169a-f814-4013-98b6-69bfef953786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:30.714700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:30.733677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 441/883] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:30.991199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917325-7642-4745-b65e-4abf19aa4c24 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:30.991903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917325-7642-4745-b65e-4abf19aa4c24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:30.992423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917325-7642-4745-b65e-4abf19aa4c24 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:30.994204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 443/884] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:30.999558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.000379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.000831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.001159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917325-7642-4745-b65e-4abf19aa4c24 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.018497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:31.019665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:31.052418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.103930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 442/885] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:31.118222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917325-7642-4745-b65e-4abf19aa4c24 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.153261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.154329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.154747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.155158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.155872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.157424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:31.166318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:31.167491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:31.168570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:31.170861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 444/886] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:31.177295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.281770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53c921-da05-476c-93c4-0f05134e4e73 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.299423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.319651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.321101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.321527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.321972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.322740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:31.323181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.324714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.330207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 443/887] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:31.335940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.376431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.452330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb51fd-7d31-45c6-a7cf-e6367b5b9bf2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.456561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.482308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1392ae-0fb8-4a42-8292-7b9257a89f8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.498063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.498676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.498955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.499216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.499848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:31.501028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.502393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa883a6c-213d-4bed-8364-b1cb81870918 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.511615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 445/888] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:31.511615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f439-e7b6-416e-ac9c-b81003cb35cf None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.511615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f439-e7b6-416e-ac9c-b81003cb35cf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.511615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f439-e7b6-416e-ac9c-b81003cb35cf None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.511615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 446/889] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:31.514587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f439-e7b6-416e-ac9c-b81003cb35cf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.523691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.524347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.524623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.524894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.535784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9ea012d8-cd00-4eb4-b8c9-d9f0f366d548 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:31.541491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:31.542442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 444/890] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:31.548445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.549242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.549242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.562267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:31.563992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:31.600805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.624482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f439-e7b6-416e-ac9c-b81003cb35cf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.638164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 445/891] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:31.638979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.661298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.662025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.662309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.662580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.663276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] RBAC: Adding query filter params (interface=public, service_id=0c58bb9877ea4c499ef43d5b93ab2b6a, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:31.663585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.664979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca90f7-6111-4394-87f0-a645e0e2c8ac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.677766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 447/892] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/endpoints?service_id=0c58bb9877ea4c499ef43d5b93ab2b6a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:31.677766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154596e7-ab02-4788-878b-535125812989 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.677766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154596e7-ab02-4788-878b-535125812989 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.677766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154596e7-ab02-4788-878b-535125812989 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.677766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 448/893] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:31.679413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154596e7-ab02-4788-878b-535125812989 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.711206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.764942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff874b-46e2-4b1d-8519-db130a695962 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.798178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154596e7-ab02-4788-878b-535125812989 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:31.801276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.801565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.801841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.802108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.802765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:31.803066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.804470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b178e5-a745-4925-8dbd-d0d2ddf6f507 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.812733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 446/894] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:31.813940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.814215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.814488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.831438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:31.832814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:31.837674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:31.838273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:31.838550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:31.838818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:31.839408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:31.840790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:31.856691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 449/895] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:28:31.858819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.860912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:31.925067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 447/896] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:31.926436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:31.991923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.010262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546527cd-dac0-4afb-8c04-5f894ff6bc22 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.049571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080749a6-7720-40d8-8415-2f1c76a39057 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.056047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.056890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.057319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.058142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.084188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.084188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:32.097661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:32.098636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:32.099914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:32.099914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:32.099914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:32.099914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 450/897] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:32.104334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.104963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.105241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.105515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.106159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.107537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.115536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.133865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 448/898] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:31 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:32.233262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.269283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7f1e-1195-424d-999d-8e4587d4ed28 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.275257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.336080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.337181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.337528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.337872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.338588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:32.338981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.340846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.356415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 451/899] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:32.363543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.374062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.405005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef0420-78be-4ef2-91a0-d40f5bcdc866 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.447384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.448535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.449059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.449547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.450326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.451978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:32.468399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:32.469421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:32.470381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:32.473189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 449/900] 10.222.0.73 () {56 vars in 1132 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:32.479176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.544323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60599a8a-9241-45d2-a3cc-6fb31b4d6eaf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.591619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.592222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.592509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.592781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.602270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.604031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.610053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:32.623963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:32.625533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:32.626483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:32.628134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 452/901] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:32.633198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.635376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85e554-c8e9-42b5-beca-93c0df20e85c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.676094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.676742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.676992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.677247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.678201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:32.678505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.680176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.688213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 450/902] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:32.692093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.719373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.765938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9315b-2d2d-4a37-b7e4-f4e595fc6149 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.802931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.803568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.803845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.804146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.804880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:32.805186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.806618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.824827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 453/903] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:32.825977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963782-0d9b-493d-97d4-6f0fd755200f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.830346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.862229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.862757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.863027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.863294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.864191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:32.864489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:32.866521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:32.876098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 451/904] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:32.881005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:32.898091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.949238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711526a-a5fc-4fab-971d-8e26ec13fecd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:32.973332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:32.986657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:32.987266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:32.987547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:32.987817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:32.999645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655c151-47b5-4688-a644-81ef2ee87255 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.046129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.047742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.048025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.048352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.049315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] RBAC: Adding query filter params (interface=public, service_id=7525c200415f4dc8b44a21ced7329d44, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:33.049619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.051477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.058539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 452/905] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/endpoints?service_id=7525c200415f4dc8b44a21ced7329d44&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:33.063745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.067707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.069729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.168092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:33.180988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 454/906] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:28:33.186080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.196364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8845c5-74b9-4cf7-a259-6fe845cfb36b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.210739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:33.245004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.246177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.246636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.247273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.248469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.251107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.264499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 453/907] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:28:33.300212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f500b-4e11-4395-b1b9-1803e5d41c80 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.345728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.346391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.346668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.346937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.358881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.361223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:33.378282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:33.379308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:33.380258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:33.380258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:33.380258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:33.380258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 455/908] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:33.385875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.497849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8caea-8067-4841-9183-092ce3e31d46 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.534675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.535286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.535617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.535893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.536624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:33.536928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.538352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.550660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 454/909] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:33.556238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.636987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:33.663871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1ce45-c09e-4459-be60-a62c02348b3b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.700728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.701358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.701637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.701911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.708923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.710364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-45b2d957-6640-484d-913e-aa9e7368a31c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:33.722110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:33.723450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:33.724947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 456/910] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:33.729387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.732629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:33.842935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf35fe2-7628-4a19-a94e-11ad2d1163a3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:33.871414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ec67-526d-41df-9552-23a36c78d35b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.871724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ec67-526d-41df-9552-23a36c78d35b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.871952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7ec67-526d-41df-9552-23a36c78d35b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.873421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 457/911] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:33.878680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.879218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.879688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.883079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:33.883777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:33.884091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:33.884347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:33.885035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:33.885338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:33.886850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:33.902331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 455/912] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:33.905124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:33.907094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:33.908779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:33.984368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 458/913] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:33.988480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:34.028464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd6b9-fafc-4132-a8a6-d1f6d3e3d12c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.067838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.068474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.068754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.069028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.069747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] RBAC: Adding query filter params (role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=77b45502aefb42cbaaa7cc4d3f63f406) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:34.070108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.071543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098d68-f8cd-45f3-9973-ac2f7ff1c1c4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.077333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 456/914] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:33 2022] GET /identity/v3/role_assignments?user.id=77b45502aefb42cbaaa7cc4d3f63f406&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:34.257128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.280892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e6b1-7841-4efc-9443-3a4addaed191 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.281375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e6b1-7841-4efc-9443-3a4addaed191 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.281751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2e6b1-7841-4efc-9443-3a4addaed191 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.283529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 457/915] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:34.289218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.289622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.289999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.308892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:34.310213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:34.330498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:34.371666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf29f2-7d99-4d31-b789-6794dc93f965 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.388195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 458/916] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:34.406816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.407660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.407938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.408239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.408818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.410173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:34.419147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:34.420191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:34.421048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 459/917] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:34.426996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.487009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:34.532146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f460d-61e9-4257-85fc-41b266f4115c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.566832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.567488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.567773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.568047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.568698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:34.569001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.570367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.578737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 459/918] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:34.581795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.684040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb386-56d9-40c5-b8e6-6c0a01485615 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.692930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.722837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:34.736749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.737346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.737623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.737891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.738519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:34.738816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.740191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.750622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 460/919] 10.222.0.73 () {56 vars in 1114 bytes} [Thu Aug 18 16:28:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:34.753126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.809164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2676-6772-4962-abdd-a61c75cffaac None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.832400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:34.849528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.850537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.851140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.851617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.852575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.854200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:34.864579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:34.865573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:34.866419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:34.869414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 460/920] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:34.875673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:34.878061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8c86-1f9b-429e-bb92-0a81c21295e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:34.927868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:34.929365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:34.930093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:34.930571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:34.931662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:34.933600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:34.967849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 461/921] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:34.995566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319f19-e4c7-48db-835d-4b875c65caa8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:35.043828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:35.044568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.044843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.045110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.045739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:35.046033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:35.047994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:35.053768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 461/922] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:35.059742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:35.117444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:35.177482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73198-8d00-49c2-aae2-eb05a1178094 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:35.213834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:35.214843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.215329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.215804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.216658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:35.217167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:35.219390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da12e7b-e3cd-437f-b896-40382add9516 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:35.225194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 462/923] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:35.230607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:35.279076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:35.311726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4759-5f5b-4e72-b703-03eb257abc77 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.312020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4759-5f5b-4e72-b703-03eb257abc77 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.312243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4759-5f5b-4e72-b703-03eb257abc77 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.314207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 463/924] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:35.319324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.319611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.319885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.339001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:35.340200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:35.344547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3839-1158-47d7-91d7-d06970ecde8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:35.392655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:35.393725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.394003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.394275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.395395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] RBAC: Adding query filter params (interface=public, service_id=6d605a7e2e904ee2b0beae185040a7e0, region_id=RegionOne) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:35.395985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:35.397645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:35.404553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 462/925] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:35 2022] GET /identity/v3/endpoints?service_id=6d605a7e2e904ee2b0beae185040a7e0&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:35.410436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:35.424581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 464/926] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:35.515251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507407d0-7680-41fa-96e0-960726679d92 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:35.525019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:35.550864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:35.551474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.551754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.552030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.552663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:35.554023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:35.560467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 463/927] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:35 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:28:35.696040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:35.747394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:35.810906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762104b7-bcc0-4347-8d09-5e23b459a128 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:35.845862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:35.846779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:35.847237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:35.847706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:35.848486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:35.850036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-abdc9f9b-d170-4a8e-aff7-8024139ba9ce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:35.858826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:35.859796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:28:35.860724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:35.863055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 465/928] 10.222.0.73 () {56 vars in 1132 bytes} [Thu Aug 18 16:28:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:35.868897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:35.976248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9498dde-adeb-4fce-98da-3317f63977bb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.011293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.011903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.012214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.012486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.013113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:36.013417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:36.014775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:36.020501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 464/929] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:36.023312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f41-67d9-4dc8-82ae-758123328c78 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.023593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f41-67d9-4dc8-82ae-758123328c78 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.023865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241f41-67d9-4dc8-82ae-758123328c78 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.025349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 466/930] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:36.025686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:36.031316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.031600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.031873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.059298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:36.061220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:36.076088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:36.143713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 467/931] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:36.166924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718558f-b08b-4e7e-952e-7a02800d6fc5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.204188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.204795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.205066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.205332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.205954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:36.206250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:36.207666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:36.213216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 465/932] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:36.218770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:36.262449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:36.322179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f80bad-ff1e-405d-951e-5de047956649 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.356111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.356714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.356992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.357262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.357921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:36.359366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:36.379893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 468/933] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:36.411152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:36.521009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:36.524356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24d6b7-9454-4e9c-8e7a-27e99617d89f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.567588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.569196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.569196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.569196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.580380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:36.585814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:36.586980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:36.588036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:36.590451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 466/934] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:36.596094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:36.695554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:36.706516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa10f14-34d1-44a0-871f-3d40685ccd0c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.742628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.743241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.743516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.743784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.744479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:36.744779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:36.746129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:36.754931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 469/935] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:36.760297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:36.865419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba651c2-96c7-4454-b9d7-0b167e7cbde6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:36.900190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:36.900799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:36.901070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:36.901341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:36.912833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:36.914268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9aee43a6-34f8-44b5-b870-9936bd75ad52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:36.929273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:36.930276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:36.931180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:36.931180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:36.931180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:36.931180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 467/936] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:36.937207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.038048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e82db-f912-4ab8-9f11-e8ac337a134a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.072211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.072817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.073093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.073359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.073990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:37.074284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.075642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.078006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7dd4-4d1d-4b10-aafe-0d7d6289fa3c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.078523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7dd4-4d1d-4b10-aafe-0d7d6289fa3c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.079007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7dd4-4d1d-4b10-aafe-0d7d6289fa3c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.080853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 468/937] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:37.085991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.086516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.086989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.088807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 470/938] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:37.097055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.108292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:37.110472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:37.113439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.116598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.192313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 469/939] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:37.211448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc452a-1334-49b9-86ef-ba919fdae9c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.246084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.246713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.247038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.247312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.254949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.256403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:37.268666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:37.269614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:37.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 471/940] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:37.275863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.381224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929235c8-caaa-44f9-b604-66db3d3686f1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.418091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.418695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.418975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.419245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.419964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:37.420295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.421908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.430015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.440686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 470/941] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:37.446364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.463534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.531922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.561701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd43c0-aaf9-47ea-827d-47ae99d66656 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.572369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76bce-a165-4885-a99d-fc1ad7fe9ec7 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.601826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.602472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.602736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.603007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.613529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.613799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.614652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.615181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.615289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.615802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.616930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.618975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.622390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING keystone.server.flask.common [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-256893de-0924-49d7-b1d3-91765dccb0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:37.630139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:37.631096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:37.632080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:37.632080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:37.632080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:37.632080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 472/942] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:37.637241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9f02-bca0-4b29-bafb-9327b5ebdfd4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.637526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9f02-bca0-4b29-bafb-9327b5ebdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.637801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9f02-bca0-4b29-bafb-9327b5ebdfd4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.639044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 473/943] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:37.639736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9f02-bca0-4b29-bafb-9327b5ebdfd4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.647891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.sql.core [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:28:37.647891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 16:28:37.647891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [parameters: {'id': 'f74e329327a842fa8f6577fd58bb37ba', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 16:28:37.647891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d5578295-801b-404c-8279-596e026f3cb5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f74e329327a842fa8f6577fd58bb37ba.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f74e329327a842fa8f6577fd58bb37ba. Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:28:37.655203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 16:28:37.656011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application yield resource Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise self.value Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application session.commit() Aug 18 16:28:37.657047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:28:37.658964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:28:37.661189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:28:37.664112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [parameters: {'id': 'f74e329327a842fa8f6577fd58bb37ba', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.667588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:37.670035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f74e329327a842fa8f6577fd58bb37ba. Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 471/944] 10.222.0.73 () {60 vars in 1140 bytes} [Thu Aug 18 16:28:37 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.674048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.676157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.676492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:37.677996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:37.733279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.757062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 472/945] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:37.758142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.763279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9f02-bca0-4b29-bafb-9327b5ebdfd4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.794064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:37.804366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.805242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.805723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.806207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.807157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:37.807687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.809281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.827184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 474/946] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:37.829084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.893432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b52f-0004-49c8-bf5d-b0eb60c14751 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.935466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779490d7-04a7-45a5-bc68-4070047c13da None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:37.939357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.940636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.941114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.941607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.948916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.950924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:37.963000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:37.963923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:37.964839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:37.971747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 473/947] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:37.972996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:37.975170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:37.975819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:37.976124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:37.976403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:37.986248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:37.988133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:38.005427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:38.006334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:38.007250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:38.011062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 475/948] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:38.012213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.029877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.061962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.096792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f482925-19d2-4c03-a23b-6dd0260e7b8b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.121152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00b88e-c2d0-4161-b2f7-0f55a797ffc6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.137041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.138172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.138871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.139319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.140156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:38.140676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.142913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.155753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.156354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.156632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.156906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.157599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:38.157907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.159798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.172228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 474/949] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:38.172228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.184459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 476/950] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:38.185418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.300292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444473-51f3-418a-b71c-c702f2af80e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.309281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.315875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94941f-2120-46f7-a6c2-436b6ad2c254 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.318386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.340359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.341176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.341563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.341941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/77b45502aefb42cbaaa7cc4d3f63f406/roles/ab6af6cca5d6424f9e4e1dec6f1e72fe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.344801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=77b45502aefb42cbaaa7cc4d3f63f406, role_id=ab6af6cca5d6424f9e4e1dec6f1e72fe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.347076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.357470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.357781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.358128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.358285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.358902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.360872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.362605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 477/951] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:38 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/77b45502aefb42cbaaa7cc4d3f63f406/roles/ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b18349cb-1c04-4cd7-a11b-6a2aed6bf1fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:38.371533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:38.372667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:38.373516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:38.378208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 475/952] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:38.379699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.400910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2928-cc41-4891-b62f-ceba8795fefd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.401192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2928-cc41-4891-b62f-ceba8795fefd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.401463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2928-cc41-4891-b62f-ceba8795fefd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.403722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 476/953] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:38.409870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.410152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.410329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.431111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:38.432426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:38.501587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901f92-ecc0-4d7b-932b-ba26b83732ac None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.523861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 477/954] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:38.546368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.546995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.547274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.547547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.548206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:38.548510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.549870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.555239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 478/955] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:38.561077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.657671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.663635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133932ca-bea3-4cfa-b731-090c3cebccb6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.701770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.702375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.702649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.702940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.703567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:38.703871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.705274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.710706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 478/956] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:38.716115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.759303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:38.825184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:38.832620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da372e-a6bf-4a60-a50f-af60c00a6fa1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.870388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.871363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.871844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.872335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.873224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.874811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.904312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 479/957] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:38.941657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb61f-da80-4fb2-8640-5afd139e4759 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:38.985964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:38.986653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:38.986982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:38.987249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] PATH_INFO: `/v3/services/compute` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:38.987853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:38.989273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:38.998749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:38.999970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:39.001774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 479/958] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:39.006417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:39.099909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:39.118155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059e56-6446-4e2b-8d67-1cf19c986fa9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:39.152293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:39.152902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:39.153181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:39.153452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:39.154072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:39.154420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:39.155784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fcb78-8eb0-47db-af41-ccb8b01f3010 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:39.161515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 480/959] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:39.167167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:39.190374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:39.271763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce1735-0205-424c-8268-f886a90d9eae None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:39.307561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:39.308914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:39.309428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:39.309912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:39.310732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:39.311248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:39.312881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ba55b-37e2-4ad6-95c4-263b2158ec6a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:39.318262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 480/960] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:40.271838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc56-ac01-487e-97c0-5c46c2d9cd10 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.272438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc56-ac01-487e-97c0-5c46c2d9cd10 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.272438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996dc56-ac01-487e-97c0-5c46c2d9cd10 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.273981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 481/961] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:40.279325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.279743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.279920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.298632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:40.300148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:40.360977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4a95-2f2e-40b6-bc7a-c795d59824ec None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.361317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4a95-2f2e-40b6-bc7a-c795d59824ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.361523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de4a95-2f2e-40b6-bc7a-c795d59824ec None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.363122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 482/962] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:40.367896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.368229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.368508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.371133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 481/963] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:40.390579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:40.391763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:40.463134 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 483/964] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:40.638766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:40.653761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:40.731814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:40.751387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23c937-258f-4120-9993-5a5903ec7a00 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:40.787896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:40.788535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.788814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.789086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.789727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:40.791269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:40.806700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.sql.core [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:28:40.806700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 16:28:40.806700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [parameters: {'user_id': '427a9c1f44ca4d70b801287b0c8d2dc6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 16:28:40.806700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:28:40.813843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:28:40.814803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application yield resource Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise self.value Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application session.commit() Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:28:40.815826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:28:40.816768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:28:40.817668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application result.read() Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:28:40.818613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [parameters: {'user_id': '427a9c1f44ca4d70b801287b0c8d2dc6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:40.819460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 16:28:40.827123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.829411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 482/965] 10.222.0.73 () {60 vars in 1131 bytes} [Thu Aug 18 16:28:40 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:40.830379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:40.830552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:40.841544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c00440-ae1f-4eed-9606-7cff257ff29e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:40.879566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:40.880210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.880543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.880818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.892726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:40.897920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:40.900297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:40.902364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:40.908969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 484/966] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:40.908969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:40.909499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:40.933466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975c84-6a44-4f23-9fea-0f27cfe20325 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:40.970842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:40.971482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.971757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.972027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:40.979513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:40.981196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-2f1a77aa-f9aa-4b8e-af3a-992a0fb297b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:40.992794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:40.994085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:40.995030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 483/967] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:40.995669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfbae-bd60-4002-a372-92abacf8a8b8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:40.995777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfbae-bd60-4002-a372-92abacf8a8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:40.996047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfbae-bd60-4002-a372-92abacf8a8b8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.000694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 484/968] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:41.001360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfbae-bd60-4002-a372-92abacf8a8b8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.027468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d2cc-f2ec-41fb-968c-40ce697a950b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.065237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.066496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.067009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.067623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.069078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:41.069588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.071317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45d0e9-9b67-48be-92ed-cdf1f8ad6085 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.086190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 485/969] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:41.086190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.086190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.086190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.090071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.102580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:41.103760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:41.116085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfbae-bd60-4002-a372-92abacf8a8b8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.153380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.153903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.154188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.154768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.155128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:41.155426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.157413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460476ba-527e-4904-9ba5-2a39b355ea55 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.168462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.180182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 486/970] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:41.180182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.195027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 485/971] 10.222.0.73 () {56 vars in 1101 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:41.287255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d0b9-e1d4-4d81-8bd5-52287450d58f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.288323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d0b9-e1d4-4d81-8bd5-52287450d58f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.288323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d0b9-e1d4-4d81-8bd5-52287450d58f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.290552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 486/972] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:41.294765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ce559-d76a-40f6-9b12-9bdc7df48d63 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.297662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.298202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.298550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.325121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:41.327558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:41.333559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.339697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.340527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.340946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.341315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.354330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.356548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:41.371536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:41.372680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:41.377436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:41.377436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:41.377436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:41.377436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 487/973] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:41.379142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.425442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 487/974] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:41.459645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.511744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871b19-77af-4521-b906-6a842b7f8a13 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.548025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.548771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.549054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.549333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.549971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:41.550392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.551870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.564800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 488/975] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:41.569804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.579583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e573f-4b32-4ef4-aa70-67117ca079e8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.602594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.614277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.614932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.615219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.615491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.616083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.617496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.619945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:41.628820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:41.629875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:41.630732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 488/976] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:41.636177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.682327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931ecb1-db86-475a-b8f2-b50c620e740a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.716426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.717063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.717342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.717610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.725869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.728864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:41.740864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:41.741863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:28:41.747959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:41.748571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037620-6355-4c4d-bd8c-2ca4e1dd5d8c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.748657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 489/977] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:41.748657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.775995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.776625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.776907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.777180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.777800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:41.778103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.779466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.784324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 489/978] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:41.785090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.836996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.846913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad46f-5534-47f6-9fc1-856519f3d44d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.849184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:41.881158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.881761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.882039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.882308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.882942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.884323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.884432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb8bbb-261e-4746-a178-ceff2083cd74 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:41.899055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 490/979] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:41 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:41.900024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:41.932312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:41.933001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:41.933243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:41.933522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:41.934247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:41.934552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:41.935987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:41.955703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 490/980] 10.222.0.73 () {56 vars in 1149 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:41.961641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.020000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233ad88-3e05-4d22-8f5e-a60e4b0b59ad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.065259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.066882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.066882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.066882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.067132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:42.067327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.068743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.072371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10e965-0d72-4fa8-b2f6-5005abb9ab77 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.073938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 491/981] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:42.079761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.080521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.108399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.113254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.114739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.115253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.115736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.184312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddfc5c-eecf-4f75-bc24-70d233382479 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.190232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.192037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.217233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.217843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.218125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.218401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.219635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] RBAC: Adding query filter params (interface=admin, service_id=6d605a7e2e904ee2b0beae185040a7e0, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:42.219978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.221351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.226330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 492/982] 10.222.0.73 () {56 vars in 1249 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/endpoints?service_id=6d605a7e2e904ee2b0beae185040a7e0&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:42.231775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.305410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 491/983] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:41 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:28:42.306978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.315375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.323678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.333432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7370b5-8d2a-4b96-a9b9-5289e75262f5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.371617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.372253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.372537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.372811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.373415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.374810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.381278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 493/984] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:28:42.430786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521683c-e0b3-4f91-ad7d-1a53ff8ad138 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.468409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.469546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.469827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.470100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.481041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.482519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:42.499109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:42.500176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:42.501355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:42.501355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:42.501355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:42.504407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 492/985] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:42.506311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.608948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce26e85-4a42-49ab-a093-17ad5d3c51a5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.642325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.642963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.643199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.643470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.644123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:42.644430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.645786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.657922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 494/986] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:42.663268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.733218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.773142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e55d1-99a9-4f3b-827b-24347c804e5b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.807172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.807879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.808252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.808588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.815925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.817447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:42.829082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:42.830172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:42.831332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:42.832777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 493/987] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:42.837599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:42.863875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:42.950177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf6b98-55f0-4c06-8595-476884a31925 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:42.984368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:42.985000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:42.985345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:42.985682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:42.986460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:42.986831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:42.988394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecde3a-09d1-4e76-bf3f-9f8606d3e009 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:43.006247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 495/988] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:43.007480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:43.107608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49efb4-3a06-417b-8699-e70c7ee4124e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:43.125699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:43.144010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:43.144704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:43.145056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:43.145397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:43.146176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] RBAC: Adding query filter params (role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=77b45502aefb42cbaaa7cc4d3f63f406) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:43.146555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:43.148038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac36f2d-e9fa-476c-b943-545ddd707b64 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:43.160097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 494/989] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:43 2022] GET /identity/v3/role_assignments?user.id=77b45502aefb42cbaaa7cc4d3f63f406&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:43.820392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e347f7-2526-4479-b32f-e582fcafe20f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:43.820931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e347f7-2526-4479-b32f-e582fcafe20f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:43.820931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e347f7-2526-4479-b32f-e582fcafe20f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:43.822399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 496/990] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:43.827409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7472-87a9-4e00-9a8d-1df7deee35dc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:43.827804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7472-87a9-4e00-9a8d-1df7deee35dc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:43.827985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e7472-87a9-4e00-9a8d-1df7deee35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:43.846267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c17e7472-87a9-4e00-9a8d-1df7deee35dc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:43.847433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c17e7472-87a9-4e00-9a8d-1df7deee35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:43.915629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 495/991] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:44.182919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e347f7-2526-4479-b32f-e582fcafe20f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.262428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:44.277862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3793e8-b36a-44a6-84cf-90fbbcc060c3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.278149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3793e8-b36a-44a6-84cf-90fbbcc060c3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.278426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3793e8-b36a-44a6-84cf-90fbbcc060c3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.279991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 496/992] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:44.285458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.285742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.286017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.289431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e347f7-2526-4479-b32f-e582fcafe20f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.303226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:44.304434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:44.323653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.324300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.324584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.324854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.325421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.326765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:44.335962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:44.336985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:44.337831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 497/993] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:44.342970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.380123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 497/994] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:44.443388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2078-814c-4e8f-b13b-be50d53520be None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.476965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.477560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.477840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.478106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.478720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:44.479018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.480395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.485248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 498/995] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:44.490657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.535178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:44.593048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5c73d-060f-4ac4-acc9-52f0af1eb48d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.626794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.627394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.627669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.627938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.628585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:44.628886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.630239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.640104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 498/996] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:44.641855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.645602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:44.655421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.762526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12555-a35f-4cb4-820a-012c032d1bac None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.765701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ecfbb-0fc4-46e5-8572-cf0b4bc9b867 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.773213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:44.799460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.800081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.800378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.800647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.801169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.801357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] RBAC: Adding query filter params (interface=public, service_id=9ece9f48b3db46a6ac8dc5228e6bfdee, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:44.801639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.801805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.802099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.802365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.802931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.803039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.804325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.808765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 499/997] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/endpoints?service_id=9ece9f48b3db46a6ac8dc5228e6bfdee&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:44.813505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:44.814730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:44.815717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 499/998] 10.222.0.73 () {56 vars in 1126 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:44.816970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.820371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.891643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:44.925094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79d177-cc16-46b6-880d-02aae4b85866 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.932765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809980a7-5fcc-445b-acc0-a5fd389f13e8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:44.961290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.962273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.962558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.962978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.963913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:44.964512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.965883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.968173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:44.968785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:44.969067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:44.969342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:44.969944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:44.970979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 500/999] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:44.972623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a5038-87a4-40ba-afce-46a0d25dea26 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:44.976434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:44.988398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 500/1000] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:28:45.015308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:45.076632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe685a8-2c10-465f-aeb6-811f6ed17888 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.076918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe685a8-2c10-465f-aeb6-811f6ed17888 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.077197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe685a8-2c10-465f-aeb6-811f6ed17888 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.078587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 501/1001] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:45.083972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.084298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.084573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.088090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1506e-509e-48ed-8fe8-d3d8a8d10c5d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:45.103565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:45.104824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:45.129055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:45.129488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.129770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.130049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.130680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:45.130986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:45.132393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:45.138480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 501/1002] 10.222.0.73 () {56 vars in 1122 bytes} [Thu Aug 18 16:28:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:45.143791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:45.183555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 502/1003] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:45.245635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:45.249954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47e799-64c4-4418-b76d-4330af78d4a6 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:45.285183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:45.285827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.286055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.286325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.286977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:45.288358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:45.304937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 502/1004] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:45.456163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:45.519642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:45.559779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926ad2c-bb12-4beb-892c-ebc070e91941 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:45.599649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:45.601489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.601489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.601489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.602923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:45.604321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:45.613276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:45.614278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:45.615175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 503/1005] 10.222.0.73 () {56 vars in 1105 bytes} [Thu Aug 18 16:28:45 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:45.620559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:45.731109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2db73-437c-42d1-a9e0-6c45593c57b9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:45.766387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:45.766985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.767259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.767527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.768167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] RBAC: Adding query filter params (name=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:45.768465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:45.769867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860682-6583-4fcb-989d-d6d380f4988f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:45.774774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 503/1006] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:45.780158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:45.879648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17486487-6d89-425c-8e2e-7b9e4ba4a5f8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:45.901302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:45.914506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:45.915106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:45.915383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:45.915652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:45.916307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:45.916611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:45.917963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bdae3-efb1-48b4-8c51-8b57f46b9e36 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:45.928158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 504/1007] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:46.901715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e479-8d0e-43e1-9cac-6cd3749d6827 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:46.902251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e479-8d0e-43e1-9cac-6cd3749d6827 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:46.902251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e479-8d0e-43e1-9cac-6cd3749d6827 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:46.903749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 504/1008] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:46.909356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58696-ed7c-446a-bca6-1164b12e451f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:46.909748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58696-ed7c-446a-bca6-1164b12e451f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:46.909937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58696-ed7c-446a-bca6-1164b12e451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:46.927704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91d58696-ed7c-446a-bca6-1164b12e451f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:46.928924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91d58696-ed7c-446a-bca6-1164b12e451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:46.998466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 505/1009] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:47.197377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcacc5-5042-4a40-bd21-36fc1dc3d79e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.197761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcacc5-5042-4a40-bd21-36fc1dc3d79e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.197951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcacc5-5042-4a40-bd21-36fc1dc3d79e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.199444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 505/1010] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:47.204883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.205176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.205438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.224369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:47.225553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:47.265182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcacc5-5042-4a40-bd21-36fc1dc3d79e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.291508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:47.300096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 506/1011] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:47.373351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcacc5-5042-4a40-bd21-36fc1dc3d79e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.407974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.408624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.408901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.409166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.409738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.411097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:47.419634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:47.420831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:28:47.421712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:47.424378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 506/1012] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:47.426795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.474147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:47.528196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489fa8c-3d5d-4de6-9025-5dce43d9ab76 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.560560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.561166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.561445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.561713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.562857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:47.563159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.564534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.569486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.574184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 507/1013] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:47.575212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.664618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:47.681681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765cbd3-1b36-41ce-99da-988958b4fd5a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.682766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ecaa4-936b-4c7b-9da4-7e79750a1cdf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.696974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:47.721721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.722334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.722614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.722992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.723726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:47.724031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.725462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.726233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.727116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.727788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.730934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.731055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 508/1014] 10.222.0.73 () {56 vars in 1112 bytes} [Thu Aug 18 16:28:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:47.731560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.733022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.735290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 507/1015] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:47.740469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.740590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:47.843246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bddd1-215f-42ab-86a6-12dd4660de61 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.846364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e5c96-3ac8-4b4f-b46d-f61e239ac9ae None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:47.876891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.877493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.877773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.878046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.878693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.879412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:47.880008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.880156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552bb13-0a87-450b-b461-809582eb24e7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.880310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.880586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.881202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:47.882632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:47.899140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 509/1016] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:47.900545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909fd8-4529-43f2-9185-e8cececc545a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.900806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909fd8-4529-43f2-9185-e8cececc545a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.901079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2909fd8-4529-43f2-9185-e8cececc545a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.902313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 510/1017] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:47.907988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31d6e-ec58-4d2d-a1b4-e21ff4fa2508 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:47.908295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31d6e-ec58-4d2d-a1b4-e21ff4fa2508 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:47.908570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31d6e-ec58-4d2d-a1b4-e21ff4fa2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:47.918848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 508/1018] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:47 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:47.928947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-afe31d6e-ec58-4d2d-a1b4-e21ff4fa2508 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:47.930273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-afe31d6e-ec58-4d2d-a1b4-e21ff4fa2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:47.960706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:48.020835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 511/1019] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:48.291498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:48.301424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:48.395023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5bea0-2bb2-424c-a70e-ca2dcedb4eb3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:48.430099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:48.430709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:48.430989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:48.431259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:48.431907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:48.433304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a675ba-1fc8-4ac8-a6cf-1adb1267cbe7 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:48.452164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 509/1020] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:28:48 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:28:49.837461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b5b2-2cc4-4a8d-a4ca-6dcb194bda99 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:49.837976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b5b2-2cc4-4a8d-a4ca-6dcb194bda99 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:49.838054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b5b2-2cc4-4a8d-a4ca-6dcb194bda99 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:49.839495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 512/1021] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:49.844953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:49.845358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:49.845561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:49.863697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:49.864884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:49.925055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:49.931399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb584-12ae-4802-bbcf-7886bd3c841e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:49.932112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb584-12ae-4802-bbcf-7886bd3c841e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:49.932609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb584-12ae-4802-bbcf-7886bd3c841e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:49.935314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 513/1022] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:49.939483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 510/1023] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:49.940207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:49.940762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:49.941232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:49.959597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:49.961070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:50.029458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 514/1024] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:50.201235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.298365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.303991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3ac95-f989-4ece-a9f6-6e891f712c28 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.342308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.343352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.343633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.343908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.345394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:50.347165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:50.348778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 511/1025] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:50.354267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.388282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:50.403551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b079ca7-4f99-4179-8900-b9802775a323 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.412734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:50.436046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.436910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.437684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.437954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.447451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-12e7f716-1c2d-41ce-8d1c-a87cae4aa69a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:50.452072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:50.453683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:50.454984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:50.455640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd64d9-e9e4-46b4-9721-580bd41c83b5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.455722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 515/1026] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:50.455722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f483-3a8d-4462-8750-0eaccb31c898 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.455722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f483-3a8d-4462-8750-0eaccb31c898 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.455924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f483-3a8d-4462-8750-0eaccb31c898 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.457005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 516/1027] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:50.461599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f483-3a8d-4462-8750-0eaccb31c898 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.491968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.492599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.492878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.493148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.493779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:50.495194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964890c-4932-4d53-a6ef-f32c3dc5517f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:50.517904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 512/1028] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:28:50 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:28:50.519539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.519730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.520004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.549925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:50.551068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:50.567790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f483-3a8d-4462-8750-0eaccb31c898 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.605730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.606364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.606642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.606916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.607593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:50.607897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:50.609373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:50.624434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 517/1029] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:50.626529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.631200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 513/1030] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:50.639890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:50.743279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9e47-9e78-4d3f-8591-46b05444fcdb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.777551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.778188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.778475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.778752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.789513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:50.790940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:50.805471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:50.806395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:50.807303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:50.807303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:50.807303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:50.807303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 518/1031] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:50.814204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.861520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:50.895978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:50.920963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c390-2f9c-4072-bd60-7696fcfc0785 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:50.959264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:50.959639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:50.960278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:50.960560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:50.960832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:50.961705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:50.962025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:50.963506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:50.975254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 514/1032] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:50.981799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.007991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce153a8-a395-4f1d-a879-8081a6d3bd50 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.044562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.045197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.045489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.045751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.046336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.048364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:51.057248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:51.058238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:51.059202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 519/1033] 10.222.0.73 () {56 vars in 1105 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:51.063995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.092388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc797d8e-c7ec-4795-95d5-067b484276f0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.100552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.131573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.132472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.132790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.133026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.140125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.141583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:51.152735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:51.153695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:51.154663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 515/1034] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:51.160589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.179526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b751b-57c4-4855-807b-fd5574d76dce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.206063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.217577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.218305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.219166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.219506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.220250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] RBAC: Adding query filter params (name=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:51.220625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.222060 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.227421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 520/1035] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:51.233152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.266873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cd8-3344-4837-8f4d-6ac68d46c342 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.302260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.302960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.303305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.303659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.304482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:51.304791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.306209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.323505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 516/1036] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:51.329259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.339778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcea41-dcb4-4cd1-96bc-90234958ef65 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.359716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.379020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.379620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.379905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.380216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.380840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:51.381149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.382502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.387216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 521/1037] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:51.394347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.440414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3b1e-ba28-4994-b097-ac38fe2ed792 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.449936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.476520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.477136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.477409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.477685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.510977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f4b24-9a0d-44bf-911b-3ee56ef41ff2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.547737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.548634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.548634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.548907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.549620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] RBAC: Adding query filter params (interface=public, service_id=d091176f9c7a4b93bcb766c2e391209b, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:51.549727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.549986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.551140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.551244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.556581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 522/1038] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/endpoints?service_id=d091176f9c7a4b93bcb766c2e391209b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:51.561802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.576698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.662992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 517/1039] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:28:51.664205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.667692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7564-d4d0-4c49-826b-dec1e2932934 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.687089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.707393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.708112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.708478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.708819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.709493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.710855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.718196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 523/1040] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:28:51.783073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d841025-acab-40f5-a464-ebd5c6929551 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.808901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:51.821308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.821959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.822238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.822513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:51.834367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:51.835783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:51.851658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:51.852893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:51.854856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:51.854856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:51.854856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:51.854856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 518/1041] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:51.858480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:51.965636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcccf16-02d2-4a11-a57c-5c8c335aed08 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:51.997889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:51.998492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:51.998769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:51.999035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.000220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:52.000774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:52.002121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:52.018847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 524/1042] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:52.020484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:52.122163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130ee9-4dfe-4b0b-9816-26a6ffddc1d8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:52.156647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:52.157435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:52.157708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:52.157972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.168811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:52.170276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:52.182864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:52.183790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:52.185149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 519/1043] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:52.190415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:52.232704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:52.291963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0592db1-5c70-4255-8cdc-eeead01c9c7d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:52.325983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:52.326585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:52.326862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:52.327131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.327867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:52.328211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:52.329628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166595-14e6-4458-8daa-b89c93b88e04 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:52.341333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 525/1044] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:52.347118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:52.383895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:52.447580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b76f67-bd2d-42b1-9444-9ad13561664c None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:52.479920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:52.480543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:52.480820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:52.481087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.481795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] RBAC: Adding query filter params (role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:52.482101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:52.483512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e503d0d-f61a-4b7e-99c8-0c0a09dd2442 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:52.492249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 520/1045] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:52 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:52.504585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9870-4932-4cb8-a506-92153cb4c181 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:52.504874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9870-4932-4cb8-a506-92153cb4c181 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:52.505173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee9870-4932-4cb8-a506-92153cb4c181 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.508104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 526/1046] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:52.512608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78cec-1518-404a-a686-6170f525b45c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:52.512912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78cec-1518-404a-a686-6170f525b45c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:52.513166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78cec-1518-404a-a686-6170f525b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:52.532693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-31f78cec-1518-404a-a686-6170f525b45c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:52.533936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-31f78cec-1518-404a-a686-6170f525b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:52.606040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 521/1047] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:52.873590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee9870-4932-4cb8-a506-92153cb4c181 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:52.974454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:52.980642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee9870-4932-4cb8-a506-92153cb4c181 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.013921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.014546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.014827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.015102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.026246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:53.031664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:53.032602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:53.033502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:53.036393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 527/1048] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:53.038811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78cec-1518-404a-a686-6170f525b45c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:53.068830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:53.140894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78cec-1518-404a-a686-6170f525b45c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.174906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.175773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.176260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.176750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.177588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:53.178068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:53.179598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:53.192250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 522/1049] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:53.194194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:53.295220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94166ab-bbc3-4683-9e57-a88687725e30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.329821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.330743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.331225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.331706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] PATH_INFO: `/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.345295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] RBAC: Authorizing `identity:get_user(user_id=d3ba24e3befc4eac8f0247f0e784a8d2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:53.346999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca9582-478c-48ac-9092-bacbcbeed806 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:53.348842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 528/1050] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:28:53 2022] GET /identity/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:53.354800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:53.447218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:53.457879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21c006-0da3-48d0-ab36-4d1e242cff74 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.491046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.491656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.491938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.492241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.560858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:53.562739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:53.633345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552a0b-9b57-4d69-a5f9-48e0129c8dca None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.633663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552a0b-9b57-4d69-a5f9-48e0129c8dca None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.633898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552a0b-9b57-4d69-a5f9-48e0129c8dca None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.636470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 529/1051] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:53.640388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.641199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.641463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.652728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:53.659606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:53.660809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:53.668220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 523/1052] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:28:53.671953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:53.677495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:53.738687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 530/1053] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:53.782402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226619a-fd64-4a62-ad68-9b23dd68941e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.817152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.817708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.817986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.818258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.819361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:53.820818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:53.822653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 524/1054] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:28:53 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:53.828555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:53.926719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185281a7-1b32-4467-8d2f-0a203f67c05c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:53.960179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611345c5-174b-443d-a407-dac667c1359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:53.960784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611345c5-174b-443d-a407-dac667c1359d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:53.961066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611345c5-174b-443d-a407-dac667c1359d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:53.961340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611345c5-174b-443d-a407-dac667c1359d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:53.962057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611345c5-174b-443d-a407-dac667c1359d None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=d0494033250748478d410d1fe84aa315, user.id=d3ba24e3befc4eac8f0247f0e784a8d2) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:53.962364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611345c5-174b-443d-a407-dac667c1359d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:53.963780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611345c5-174b-443d-a407-dac667c1359d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:53.969349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 531/1055] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:28:53 2022] GET /identity/v3/role_assignments?user.id=d3ba24e3befc4eac8f0247f0e784a8d2&scope.project.id=d0494033250748478d410d1fe84aa315&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:54.006597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.070812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:54.117567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab1c0-59ef-41f6-836b-a5f14a16e3d8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:54.152267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:54.152892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.153168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.153437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.154013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:54.155363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:54.164716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:54.165690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:54.166544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 525/1056] 10.222.0.73 () {56 vars in 1105 bytes} [Thu Aug 18 16:28:54 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:54.173956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611345c5-174b-443d-a407-dac667c1359d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.189445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:54.276142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611345c5-174b-443d-a407-dac667c1359d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:54.310117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:54.310721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.311002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.311270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.311893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] RBAC: Adding query filter params (name=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:54.312260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:54.313618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6e51-28cd-404d-8f74-560a06ea4447 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:54.318591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 532/1057] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:54.324129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.380458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd9c6-707f-4a1b-9c94-b648785fa19c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.381014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd9c6-707f-4a1b-9c94-b648785fa19c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.381298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd9c6-707f-4a1b-9c94-b648785fa19c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.382615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 533/1058] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:54.387846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.388148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.388421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.407988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:54.409206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:54.436163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715fb25-10aa-472a-97df-06c348f2c4e4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:54.461271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:54.474196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:54.474799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.475078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.475350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.476197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:54.476320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:54.477637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:54.480916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 534/1059] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:54.487532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 526/1060] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:54.489147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.497800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:54.589504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a425d-cdc2-4559-85ea-02b9798cccf8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:54.623630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:54.624265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.624575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.624849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.625753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:54.627109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:54.652124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 535/1061] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:28:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:28:54.753635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.862208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3bed-65f8-4285-8369-0405897d85d8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:54.902174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:54.902803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:54.903077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:54.903351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:54.914415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:54.919093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:54.920022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:54.920920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 527/1062] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:54.927582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:54.989829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.032419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9ff34-ba97-40e4-89da-f8e472bfa022 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.066728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.067336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.067615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.067881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.068568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:55.068872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.070224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.078931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 536/1063] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:55.084402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.131540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.185839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d02b7b-2540-4cf2-b9be-55af91b05483 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.218491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.219166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.219443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.219710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.230787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.232229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:55.246110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:55.247040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:55.247928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:55.247928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:55.247928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:55.252131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 528/1064] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:55.253773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.351484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16203c7-5bc3-4b54-8ebd-b7cf88f56ba2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.374079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.385894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.386434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.386710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.386977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.387605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:55.387902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.389343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.401178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 537/1065] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:55.406577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.507876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.514530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae47d-c0d2-4b92-b7d5-0c4c845ffaf5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.548727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.549351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.549623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.549889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.557407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.558924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:55.569820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:55.570772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:55.571720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:55.575707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 529/1066] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:55.576720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.678221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23e31-f41f-46a0-85a5-8203f961ced9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.713143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.713745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.714022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.714290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.715075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:55.715392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.718986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334e201-4199-46d0-ad38-60f82da1e807 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.744724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 538/1067] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:55.745949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.847290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba809369-69b8-408f-8033-96d4c15b8deb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:55.867214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139ed0-3054-44b2-8a25-c7041b086dcb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.867494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139ed0-3054-44b2-8a25-c7041b086dcb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.867763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23139ed0-3054-44b2-8a25-c7041b086dcb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.869124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 539/1068] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:55.873996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.874271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.874569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.884220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:55.884855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:55.885138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:55.885414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:55.896754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:55.897841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:55.898092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:55.899275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:55.916210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:55.917177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:55.918102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:55.918102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:55.918102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:55.918102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 530/1069] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:55.922936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:55.934350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.939228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:55.975343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 540/1070] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:56.028070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405adb9c-60bf-4081-8bab-efdc8e3b3bbc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.061826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.062505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.062787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.063062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.063694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:56.063997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.065384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.082277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 531/1071] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:56.083408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.182492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cdf1-7831-4a7c-94f6-272f9bbdc9b9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.215843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.216422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.216700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.216971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.223989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.225459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:28:56.236300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:56.237207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:56.238130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 541/1072] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:56.239814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.242810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.274862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.310186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.347268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e963ff4-fca9-4af0-83da-8c11868067be None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.350155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325399e-27cb-47c4-8a1b-fd384478099f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.385763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.386369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.386649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.386922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.387405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.387616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:56.387907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.388823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.389318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.389424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.389881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.401406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:56.402689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 542/1073] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:56.406292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:56.407315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:56.408856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:56.410176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.412380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 532/1074] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:56.414509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.505156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.514988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321ea-2127-461d-b842-00148ef9dc1d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.520601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884faa76-8918-41c1-a76e-aab51297c570 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.549132 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.554461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.555126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.555404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.555673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/ab6af6cca5d6424f9e4e1dec6f1e72fe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.557790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.557923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=92d15db5127347b8b25cdf41abb2ab07, role_id=ab6af6cca5d6424f9e4e1dec6f1e72fe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.558391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.558666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.558933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.559361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022079f4-7b90-43bf-9069-e033cbf8dc0a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.559583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:56.559881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.561260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.571367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 533/1075] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:56.576089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 543/1076] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:56 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/92d15db5127347b8b25cdf41abb2ab07/roles/ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:28:56.581563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.586331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290e35-7496-4598-8ee3-7b694d1d4316 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.586620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290e35-7496-4598-8ee3-7b694d1d4316 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.586899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290e35-7496-4598-8ee3-7b694d1d4316 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.588332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 544/1077] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:56.596468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.596776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.597042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.616757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:56.618020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:56.697617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 545/1078] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:56.709437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de3e2a-23fb-40ae-a0bf-4b423b0c48c0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.751076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.751718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.751997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.752301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] PATH_INFO: `/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.753466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] RBAC: Authorizing `identity:get_user(user_id=d3ba24e3befc4eac8f0247f0e784a8d2)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.754910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.756943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 534/1079] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:56.762597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.845118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.865834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972341-c449-43db-a8ff-9ce3bc5e246a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:56.901290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:56.901924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:56.902199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:56.902466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:56.903561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:56.905030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:56.911554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 546/1080] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:56.913062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:56.971777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:56.995324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:57.016618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce582a1-d742-4908-8391-5abdf8d732e2 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:57.053725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:57.054384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:57.054662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:57.054935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315/users/d3ba24e3befc4eac8f0247f0e784a8d2/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:57.056882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] RBAC: Authorizing `identity:create_grant(project_id=d0494033250748478d410d1fe84aa315, user_id=d3ba24e3befc4eac8f0247f0e784a8d2, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:57.058394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:57.072965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 535/1081] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:28:56 2022] PUT /identity/v3/projects/d0494033250748478d410d1fe84aa315/users/d3ba24e3befc4eac8f0247f0e784a8d2/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:28:57.127158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbe98-2601-44e8-8971-2a70f61967bb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:57.166439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:57.167483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:57.167964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:57.168459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:57.190081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:57.247063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:57.248554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:57.347255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 547/1082] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:28:57.353138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:57.455448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6ccd3-014d-4888-8e5c-e278efd4884a None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:57.472873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:57.492928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:57.493724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:57.494008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:57.494280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:57.506276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:57.507783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-475c712c-14d4-4014-ab04-12e45a46d27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:57.522585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:57.523535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:57.524479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:57.524479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:57.524479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:57.528139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 536/1083] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:57.529740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:57.581361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:57.632280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611e080-fecb-4cc6-864b-0fbdcb236e2b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:57.667411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:57.668045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:57.668348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:57.668618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:57.669272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:57.669575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:57.670951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb06a-c050-4359-a878-ab0a280e7e2f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:57.683059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 548/1084] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:58.472606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504288da-c7ee-45a8-aed8-a1d7da1bc996 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:58.473141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504288da-c7ee-45a8-aed8-a1d7da1bc996 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:58.473141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504288da-c7ee-45a8-aed8-a1d7da1bc996 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:58.474487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 537/1085] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:28:58.479670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafc98-1f2c-4bed-9b2c-27212107da63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:58.480090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafc98-1f2c-4bed-9b2c-27212107da63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:58.480366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eafc98-1f2c-4bed-9b2c-27212107da63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:58.498491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-25eafc98-1f2c-4bed-9b2c-27212107da63 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:58.500226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-25eafc98-1f2c-4bed-9b2c-27212107da63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:58.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 549/1086] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:28:58.830096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504288da-c7ee-45a8-aed8-a1d7da1bc996 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:58.930202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504288da-c7ee-45a8-aed8-a1d7da1bc996 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:58.963741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:58.964386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:58.964661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:58.964924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:58.973052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b9fd-e0a4-4d43-92ea-12e8e7f662d6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:58.973343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b9fd-e0a4-4d43-92ea-12e8e7f662d6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:58.973617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303b9fd-e0a4-4d43-92ea-12e8e7f662d6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:58.974945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 550/1087] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:28:58.975246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:58.979851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:58.981068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:28:58.981939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:58.982606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:58.982606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:58.982606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:58.982790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 538/1088] 10.222.0.73 () {56 vars in 1120 bytes} [Thu Aug 18 16:28:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:58.986449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:58.998113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:28:58.999291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:28:59.016995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.033706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.064916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 551/1089] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:28:59.086110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057945fe-6374-4da2-ba2a-971034aeb899 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.119565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.120185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.120460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.120727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.121373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:59.121673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.123024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.130858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 539/1090] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:28:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:59.136513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.233268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097d25d-b673-4319-9f01-bbae0c249b33 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.266190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.266802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.267078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.267346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.276791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.278204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:28:59.292805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:59.293949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:28:59.295022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:28:59.295022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:28:59.295022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:59.295022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 552/1091] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:28:59.299676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.332396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.357079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.389961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.399477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9552544-4b82-42aa-8461-bc7e70eafd05 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.432539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.433147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.433423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.433520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a8b9-4da7-432b-9f59-f81c9988fb8b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.433694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.434324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:59.434625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.436037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.448046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 540/1092] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:28:59.454132 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.469280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.469896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.470170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.470435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.480634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:28:59.485509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:59.486550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:28:59.487423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 553/1093] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:59.497982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.553114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcc52e-cea5-48b5-b88e-d8b8730435cc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.579376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.587117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.587739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.588017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.588322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.595159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.596722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.597321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757fc2-258e-4c06-87c8-27cfab273491 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:28:59.607777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:28:59.608820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:28:59.609797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 541/1094] 10.222.0.73 () {56 vars in 1093 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:28:59.614714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.629300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.634935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.635541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.635822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.636118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.636785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:59.637089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.638452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.648039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 554/1095] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:59.653825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.712680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc4f9-0b2a-45ce-a314-082b0fad5f48 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.752806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.753358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.753643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.754156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.754624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:28:59.754934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.756415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.756996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2bc06-2aea-4e01-a246-eba0ea2baa6d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.773926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 542/1096] 10.222.0.73 () {56 vars in 1133 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:59.779491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.790048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.790675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.790957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.791227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] PATH_INFO: `/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.792375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] RBAC: Authorizing `identity:get_user(user_id=d3ba24e3befc4eac8f0247f0e784a8d2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.793787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.799039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 555/1097] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/users/d3ba24e3befc4eac8f0247f0e784a8d2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:28:59.801600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:28:59.815995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.848163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:28:59.879388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676b45-2660-4647-b157-5b088d70c870 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.897936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17b4d-8a3e-484c-8e14-2e51934d1b6f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:28:59.911886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.912525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.912803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.913071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.931263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:28:59.931849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:28:59.932150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:28:59.932417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:28:59.978688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.980154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:28:59.995876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:28:59.997335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.010889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.046965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.077615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 543/1098] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:29:00.083311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.092502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 556/1099] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:28:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:29:00.098675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.182319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459cb3-ba34-4e68-9528-6959afff8400 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.195267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed3e1f-4775-46ed-8326-2e7df7bb8fa6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.208188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.215465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.216112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.216397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.216673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.227398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.228872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.228977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.229511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.229785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.230052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.231149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.232575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.234735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 557/1100] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:29:00.240660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:29:00.243526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:00.244496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:29:00.245410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:29:00.245410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:29:00.245410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:00.245410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 544/1101] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:29:00.249958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.273474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.335541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f716e-43b0-4d82-a867-30410ccb133c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.347664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ebfbf-da2c-4540-bf87-d6ad46551611 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.369901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.370502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.370778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.371046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.371762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=d0494033250748478d410d1fe84aa315, user.id=d3ba24e3befc4eac8f0247f0e784a8d2) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:00.372084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.373502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.379223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 558/1102] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/role_assignments?user.id=d3ba24e3befc4eac8f0247f0e784a8d2&scope.project.id=d0494033250748478d410d1fe84aa315&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:29:00.380110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.380711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.380990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.381261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.381892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:00.382195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.383565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.397177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 545/1103] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:29:00.403032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.451429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.509841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b743f9-c03a-4da5-bfca-9db41d953486 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.545280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.545811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.546087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.546384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.552780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.554202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:29:00.565771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:00.566853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:29:00.568021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 559/1104] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:00.572850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.653817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.672824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b44a48-f2a2-4567-8337-5d2205d69d08 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.705924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.706528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.706807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.707080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.707763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:00.708082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.709519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cb99-b90a-4f7f-b06d-1a2fcc5226ae None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.721481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 546/1105] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:00.727533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:00.829050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31b909-a0e6-40ca-9662-5a9c0b2078c4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:00.831282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:00.862508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:00.863106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:00.863384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:00.863652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:00.864470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] RBAC: Adding query filter params (role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=92d15db5127347b8b25cdf41abb2ab07) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:00.864777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:00.866191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bd163-2748-4b83-8c47-12b8635b36b9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:00.871745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 560/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:00 2022] GET /identity/v3/role_assignments?user.id=92d15db5127347b8b25cdf41abb2ab07&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=ab6af6cca5d6424f9e4e1dec6f1e72fe => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:02.291185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e3f9-a097-4a15-8707-dca5145c1172 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:02.291730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e3f9-a097-4a15-8707-dca5145c1172 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:02.291730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e3f9-a097-4a15-8707-dca5145c1172 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:02.293125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 547/1107] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:02.298164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:02.298547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:02.298714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:02.316733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:02.317903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:02.381386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 561/1108] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:02.665968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e3f9-a097-4a15-8707-dca5145c1172 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:02.764970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e3f9-a097-4a15-8707-dca5145c1172 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:02.797175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:02.797786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:02.798063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:02.798329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:02.799419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:02.800857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61f075-e619-4a24-85c8-3326cf7d725c None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:02.802407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 548/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:02.808070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:02.899346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:02.903115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082a12-8fa1-41fc-96be-2b81fc7927b1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:02.936121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:02.936679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:02.937550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:02.937830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:02.938473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:02.939888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7202dc1-849d-4a76-987f-abb44a023d2c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:02.959298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 562/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:29:02 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:29:04.865182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea19d8-de2f-4287-8290-7ec0e24a5ff3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:04.865714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea19d8-de2f-4287-8290-7ec0e24a5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:04.865714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea19d8-de2f-4287-8290-7ec0e24a5ff3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:04.867102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 549/1111] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:04.872049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:04.872433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:04.872609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:04.890902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:04.892088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:04.955265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 563/1112] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:05.218851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea19d8-de2f-4287-8290-7ec0e24a5ff3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:05.230981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:05.317364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea19d8-de2f-4287-8290-7ec0e24a5ff3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:05.349824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:05.350437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:05.350717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:05.350992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] PATH_INFO: `/v3/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:05.352386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] RBAC: Authorizing `identity:get_role(role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:05.353744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:05.355030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 550/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:05 2022] GET /identity/v3/roles/aea8cb3d868e426794cd392f72d51d71 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:05.360927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:05.439121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:05.455416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f2c1-cedb-4e03-b802-7cacea201e00 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:05.488155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:05.488709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:05.488984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:05.489253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] PATH_INFO: `/v3/users/f28a9e1db025484291f3122e3f4d21cb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:05.501875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a9e1db025484291f3122e3f4d21cb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:05.503294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:05.504867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 564/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:05 2022] GET /identity/v3/users/f28a9e1db025484291f3122e3f4d21cb => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:05.510613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:05.586444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:05.608134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48e735-6fe2-4778-8398-1ff8169b51b3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:05.641855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:05.642452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:05.642736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:05.643011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:05.708112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:05.709556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:05.784667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:05.805634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 551/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:05.811632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:05.906263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242080d-5705-4742-a546-0f188c3e1524 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:05.937980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:05.938589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:05.938866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:05.939133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:05.940249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:05.941659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b57a-a3d2-4fee-acbf-4f6ebe298170 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:05.943221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 565/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:05 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:05.949154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:06.044423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466aa7a-5633-488f-a4a7-bc0c87b1cbfe None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:06.077016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:06.077658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:06.077937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:06.078212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:06.078917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=d0494033250748478d410d1fe84aa315, user.id=f28a9e1db025484291f3122e3f4d21cb) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:06.079222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:06.080703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc590-536a-4fb9-b9fb-f2ec97d6b900 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:06.085795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 552/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:05 2022] GET /identity/v3/role_assignments?user.id=f28a9e1db025484291f3122e3f4d21cb&scope.project.id=d0494033250748478d410d1fe84aa315&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:07.925453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f53fc-632a-4a1b-91da-22e3b5ad8b22 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:07.925968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f53fc-632a-4a1b-91da-22e3b5ad8b22 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:07.925968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f53fc-632a-4a1b-91da-22e3b5ad8b22 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:07.927308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 566/1118] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:07.932388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:07.932810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:07.932941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:07.950362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:07.951534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:07.985932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:08.016646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 553/1119] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:08.283121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f53fc-632a-4a1b-91da-22e3b5ad8b22 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:08.295182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:08.381697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f53fc-632a-4a1b-91da-22e3b5ad8b22 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:08.413971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:08.414584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:08.414865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:08.415137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] PATH_INFO: `/v3/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:08.416519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] RBAC: Authorizing `identity:get_role(role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:08.417891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:08.419172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 567/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:08 2022] GET /identity/v3/roles/aea8cb3d868e426794cd392f72d51d71 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:08.424877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:08.519289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e81fe-f046-49f7-97c4-a7d2a9baace9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:08.551203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:08.551757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:08.552037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:08.552342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] PATH_INFO: `/v3/users/f28a9e1db025484291f3122e3f4d21cb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:08.553445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a9e1db025484291f3122e3f4d21cb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:08.554863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:08.556444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 554/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:08 2022] GET /identity/v3/users/f28a9e1db025484291f3122e3f4d21cb => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:08.562371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:08.636661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:08.657880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330617a6-b8b7-4fb7-af70-d5d2cd347e87 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:08.690530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:08.691135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:08.691413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:08.691681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:08.692838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:08.694245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f17327-f8b6-440c-83c6-1408d773ac92 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:08.695815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 568/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:08 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:08.701641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:08.744143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:08.800330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da783a6-a719-48ce-b6b7-3e24bf33ad22 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:08.832097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:08.832836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:08.833110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:08.833378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315/users/f28a9e1db025484291f3122e3f4d21cb/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:08.835450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0494033250748478d410d1fe84aa315, user_id=f28a9e1db025484291f3122e3f4d21cb, role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:08.836888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427d32c-01dd-449d-8b2f-7d8c68b45635 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:08.849404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 555/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:29:08 2022] PUT /identity/v3/projects/d0494033250748478d410d1fe84aa315/users/f28a9e1db025484291f3122e3f4d21cb/roles/aea8cb3d868e426794cd392f72d51d71 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:29:10.703033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e315-1682-41c4-85fb-ccc77f5e729e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:10.703568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e315-1682-41c4-85fb-ccc77f5e729e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:10.703568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23e315-1682-41c4-85fb-ccc77f5e729e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:10.704919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 569/1124] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:10.710150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:10.710591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:10.710689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:10.728526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:10.729699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:10.794015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 556/1125] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:29:11.063457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23e315-1682-41c4-85fb-ccc77f5e729e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:11.160259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23e315-1682-41c4-85fb-ccc77f5e729e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:11.193145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:11.193753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:11.194034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:11.194306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] PATH_INFO: `/v3/roles/aea8cb3d868e426794cd392f72d51d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:11.195670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] RBAC: Authorizing `identity:get_role(role_id=aea8cb3d868e426794cd392f72d51d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:11.197056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:11.198324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 570/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:11 2022] GET /identity/v3/roles/aea8cb3d868e426794cd392f72d51d71 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:11.203918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:11.232002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:11.299802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12f82-6ddb-4a1d-b09d-358417314869 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:11.331659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:11.332239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:11.332515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:11.332786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] PATH_INFO: `/v3/users/f28a9e1db025484291f3122e3f4d21cb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:11.333869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a9e1db025484291f3122e3f4d21cb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:11.335271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:11.336833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 557/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:11 2022] GET /identity/v3/users/f28a9e1db025484291f3122e3f4d21cb => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:11.342402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:11.357960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:11.439229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bced-fbe5-4f33-a061-3701629e8357 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:11.473936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:11.474531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:11.474813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:11.475086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:11.539564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:11.541016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:11.554941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:11.635259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 571/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:11.641750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:11.734639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:11.738737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db42a-d86b-4427-a7a0-607dcf762bf0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:11.771649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:11.772294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:11.772575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:11.772846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] PATH_INFO: `/v3/projects/d0494033250748478d410d1fe84aa315` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:11.773935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] RBAC: Authorizing `identity:get_project(project_id=d0494033250748478d410d1fe84aa315)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:11.775358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ee4c4-e3e8-4944-92a7-11db77d4be7b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:11.776999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 558/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:11 2022] GET /identity/v3/projects/d0494033250748478d410d1fe84aa315 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:11.783746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:11.878603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32f00d-419b-4245-9c5e-a5b8c43af279 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:11.892872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:11.912845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:11.913428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:11.913704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:11.913971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:11.914678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] RBAC: Adding query filter params (role.id=aea8cb3d868e426794cd392f72d51d71, scope.project.id=d0494033250748478d410d1fe84aa315, user.id=f28a9e1db025484291f3122e3f4d21cb) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:11.914981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:11.916425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f946-5916-49e2-b638-62e46e86edb2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:11.921879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 572/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:11 2022] GET /identity/v3/role_assignments?user.id=f28a9e1db025484291f3122e3f4d21cb&scope.project.id=d0494033250748478d410d1fe84aa315&role.id=aea8cb3d868e426794cd392f72d51d71 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:13.788482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8418-ddc3-4c15-9caf-e4b137b7be79 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:13.788979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8418-ddc3-4c15-9caf-e4b137b7be79 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:13.789088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8418-ddc3-4c15-9caf-e4b137b7be79 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:13.790341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 559/1131] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:13.795295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:13.795718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:13.795844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:13.813973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:13.815142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:13.879177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 573/1132] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:29:14.145749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8418-ddc3-4c15-9caf-e4b137b7be79 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:14.242802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8418-ddc3-4c15-9caf-e4b137b7be79 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:14.275176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:14.275773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:14.276048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:14.276447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:14.277528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:14.278933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821406a-1259-4afc-ba81-a411ecb13eb3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:14.281012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 560/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:29:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:14.286650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:14.380859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28ae10-6a10-4daa-9f93-ef6e6bf68935 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:14.389622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:14.414048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:14.414589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:14.414870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:14.415141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:14.415773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:14.417222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4f7f-5e7a-41f1-96cb-02af1dcf6a83 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:14.442822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 574/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:29:14 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:29:16.346704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68451-0920-4082-b02f-2b2c4ac2d9dd None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:16.347249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68451-0920-4082-b02f-2b2c4ac2d9dd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:16.347249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68451-0920-4082-b02f-2b2c4ac2d9dd None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:16.348604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 561/1135] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:16.353787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:16.354176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:16.354339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:16.371988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:16.373185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:16.436745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 575/1136] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:16.713723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68451-0920-4082-b02f-2b2c4ac2d9dd None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:16.747592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:16.811417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68451-0920-4082-b02f-2b2c4ac2d9dd None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:16.843871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:16.844505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:16.844777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:16.845041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:16.846109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:16.847519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2c826-e553-4059-ab9d-d923404db8ec None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:16.849069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 562/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:29:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:16.854817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:16.941230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:16.951238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08c643-d699-4d46-9e27-131a78ef03a5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:16.983033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:16.984112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:16.984393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:16.984663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:16.985291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:16.986702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc179-f418-47e1-b096-fac11afe7596 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:17.006929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 576/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:29:16 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:29:18.907229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4aa7f-aa50-4796-bf5c-f7859e5d45c3 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:18.907780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4aa7f-aa50-4796-bf5c-f7859e5d45c3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:18.907780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4aa7f-aa50-4796-bf5c-f7859e5d45c3 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:18.909161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 563/1139] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:18.914152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:18.914516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:18.914697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:18.932663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:18.933835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:18.997126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 577/1140] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:19.262491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4aa7f-aa50-4796-bf5c-f7859e5d45c3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:19.359264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4aa7f-aa50-4796-bf5c-f7859e5d45c3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:19.360749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:19.404902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:19.405538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:19.405817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:19.406094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:19.419612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:19.424794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:19.426061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:19.426978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 564/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:19.431795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:19.506322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:19.529390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256081d-1716-46db-b4c6-0a8ec68f1895 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:19.562956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:19.563548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:19.563826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:19.564119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:19.564771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:19.565069 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:19.566420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:19.574014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 578/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:19.579827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:19.676658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ada9b-3401-4621-b512-af788aafeeb0 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:19.708459 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:19.709075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:19.709355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:19.709628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] PATH_INFO: `/v3/users/b4d8d78980a34fe68b455228c57bd6bc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:19.723351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] RBAC: Authorizing `identity:get_user(user_id=b4d8d78980a34fe68b455228c57bd6bc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:19.724819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:19.726426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 565/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:19 2022] GET /identity/v3/users/b4d8d78980a34fe68b455228c57bd6bc => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:19.732503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:19.827243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757fb9f-aff2-4f59-87c8-c71223c36d46 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:19.859125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:19.859708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:19.859983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:19.860274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:19.868236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:19.925597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:19.927008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:20.020350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 579/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:20.026106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:20.047515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:20.122205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d4cba-a107-4536-b1a0-9ae284db3056 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:20.154817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:20.155978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:20.156281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:20.156550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] PATH_INFO: `/v3/projects/464d46a727104585850f063d3bc51b75` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:20.157643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] RBAC: Authorizing `identity:get_project(project_id=464d46a727104585850f063d3bc51b75)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:20.159047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619b0f8-c5d7-48d3-90ae-cdef8822ba6e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:20.160682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 566/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:20 2022] GET /identity/v3/projects/464d46a727104585850f063d3bc51b75 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:20.166618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:20.204328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:20.260558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8bee5-b580-4566-811a-3a70816de1e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:20.292900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:20.293475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:20.293748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:20.294014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:20.294713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=464d46a727104585850f063d3bc51b75, user.id=b4d8d78980a34fe68b455228c57bd6bc) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:20.295012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:20.296425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be769e19-b282-4b1e-a863-785adb56bbdc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:20.301457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 580/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:20 2022] GET /identity/v3/role_assignments?user.id=b4d8d78980a34fe68b455228c57bd6bc&scope.project.id=464d46a727104585850f063d3bc51b75&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:22.133703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44192-1322-4ed6-b67a-2b8fb1efd8f0 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:22.134196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44192-1322-4ed6-b67a-2b8fb1efd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:22.134196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44192-1322-4ed6-b67a-2b8fb1efd8f0 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:22.135495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 567/1147] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:22.140700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:22.141118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:22.141230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:22.159269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:22.160463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:22.223124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 581/1148] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:22.487359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44192-1322-4ed6-b67a-2b8fb1efd8f0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:22.572452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:22.584758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44192-1322-4ed6-b67a-2b8fb1efd8f0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:22.617215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:22.617824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:22.618097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:22.618365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:22.628257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:22.632889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:22.634020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:22.635206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 568/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:22.639825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:22.669598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:22.735911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a177cf-8aba-47a6-ad5e-154a33dd2546 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:22.768945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:22.769483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:22.769767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:22.770039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:22.770691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:22.770995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:22.772396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:22.780077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 582/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:22.786309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:22.882680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee43b3-e0b4-43fc-a6a7-0bc3e22b6322 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:22.915530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:22.916273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:22.916560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:22.916834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] PATH_INFO: `/v3/users/b4d8d78980a34fe68b455228c57bd6bc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:22.917937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] RBAC: Authorizing `identity:get_user(user_id=b4d8d78980a34fe68b455228c57bd6bc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:22.919359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:22.920961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 569/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:22 2022] GET /identity/v3/users/b4d8d78980a34fe68b455228c57bd6bc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:22.926437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:23.016995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:23.023758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581e941-ccb0-4b78-bb2a-34519687bb61 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:23.055509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:23.056150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:23.056422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:23.056687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] PATH_INFO: `/v3/projects/464d46a727104585850f063d3bc51b75` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:23.057763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] RBAC: Authorizing `identity:get_project(project_id=464d46a727104585850f063d3bc51b75)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:23.059200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5768231-1ce3-4577-b307-7f20072331fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:23.060793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 583/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:22 2022] GET /identity/v3/projects/464d46a727104585850f063d3bc51b75 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:23.066602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:23.084987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:23.163315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421befb0-5da3-44b6-aa23-99c045b3a304 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:23.194273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:23.194903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:23.195174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:23.195440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] PATH_INFO: `/v3/projects/464d46a727104585850f063d3bc51b75/users/b4d8d78980a34fe68b455228c57bd6bc/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:23.197304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] RBAC: Authorizing `identity:create_grant(project_id=464d46a727104585850f063d3bc51b75, user_id=b4d8d78980a34fe68b455228c57bd6bc, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:23.198703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8e813-d4da-4316-9d94-14312c23255e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:23.211619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 570/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:29:23 2022] PUT /identity/v3/projects/464d46a727104585850f063d3bc51b75/users/b4d8d78980a34fe68b455228c57bd6bc/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:29:25.064748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa3da-23ee-409c-bfe6-0059781fe137 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.065255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa3da-23ee-409c-bfe6-0059781fe137 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.065255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fa3da-23ee-409c-bfe6-0059781fe137 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:25.066536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 584/1154] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:25.071586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.071997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.072156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:25.090094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:25.091252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:25.157534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 571/1155] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:25.422190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa3da-23ee-409c-bfe6-0059781fe137 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:25.518907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fa3da-23ee-409c-bfe6-0059781fe137 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:25.551608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:25.552239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.552517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.552786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:25.562448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:25.567120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:25.568242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:29:25.569312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 585/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:25.574026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:25.581988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:25.673275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c94182-f37c-48d9-9a99-f7e2a49f8cc8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:25.705141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:25.705732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.706007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.706275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:25.706924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:25.707222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:25.708607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:25.716368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 572/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:25.722679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:25.747261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:25.820186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462626ac-732e-42ef-892c-6b282f0e8d0c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:25.852129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:25.852740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.853019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.853290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] PATH_INFO: `/v3/users/b4d8d78980a34fe68b455228c57bd6bc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:25.854386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] RBAC: Authorizing `identity:get_user(user_id=b4d8d78980a34fe68b455228c57bd6bc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:25.855800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:25.857372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 586/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:25 2022] GET /identity/v3/users/b4d8d78980a34fe68b455228c57bd6bc => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:25.863822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:25.929639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:25.961706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bc6fd-1ae3-42eb-a755-d7125d382e77 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:25.993205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:25.993790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:25.994064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:25.994331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:26.057273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:26.058702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:26.119259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:26.153045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 573/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:26.158925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:26.245598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:26.255945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f6510-a919-49d6-8424-fcdac20e71ac None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:26.288571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:26.289180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:26.289461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:26.289735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] PATH_INFO: `/v3/projects/464d46a727104585850f063d3bc51b75` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:26.290834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] RBAC: Authorizing `identity:get_project(project_id=464d46a727104585850f063d3bc51b75)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:26.292296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2140d1-1d53-4fdc-a947-ea335df5964c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:26.293877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 587/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:26 2022] GET /identity/v3/projects/464d46a727104585850f063d3bc51b75 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:26.300592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:26.394634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbc550-bd17-492e-b831-555d7116e309 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:26.427626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:26.428241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:26.428523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:26.428796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:26.429508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=464d46a727104585850f063d3bc51b75, user.id=b4d8d78980a34fe68b455228c57bd6bc) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:26.429820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:26.431230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebff732-296d-4909-9652-0b420484b0a2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:26.436816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 574/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:26 2022] GET /identity/v3/role_assignments?user.id=b4d8d78980a34fe68b455228c57bd6bc&scope.project.id=464d46a727104585850f063d3bc51b75&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:28.320245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360f91-7fcf-43c4-8a58-424571a5778c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:28.320772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360f91-7fcf-43c4-8a58-424571a5778c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:28.320772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360f91-7fcf-43c4-8a58-424571a5778c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:28.322113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 588/1162] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:28.327658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:28.328122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:28.328234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:28.346256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:28.347417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:28.371822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:28.412226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 575/1163] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:28.678724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360f91-7fcf-43c4-8a58-424571a5778c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:28.777780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360f91-7fcf-43c4-8a58-424571a5778c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:28.811971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:28.812597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:28.812962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:28.813285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:28.839698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:28.878504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:28.879923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:28.971437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 589/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:28.977272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:29.071919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2614-eb8c-46ea-8542-4d1f55922320 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:29.103320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:29.103925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:29.104226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:29.104492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:29.111387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:29.112828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a39bc775-0b37-4a1c-866f-167febcaf0f6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:29.124649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:29.125887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:29.127222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 576/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:29:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:29.131755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:29.187553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:29.226893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52875300-86e0-452a-9a35-37a96a46f1bc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:29.260257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:29.260846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:29.261124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:29.261392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:29.262018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:29.262322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:29.263675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5abb-ef80-45e1-8ceb-b82b7fc7a4d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:29.270473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 590/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Thu Aug 18 16:29:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:31.120052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c913f-ba7e-4074-83b0-d19a053d41df None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:31.120582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c913f-ba7e-4074-83b0-d19a053d41df None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:31.120582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c913f-ba7e-4074-83b0-d19a053d41df None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:31.121893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 577/1167] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:31.127300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fd3b0-b110-40f9-8ab2-7a78c13f2b9d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:31.127674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fd3b0-b110-40f9-8ab2-7a78c13f2b9d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:31.127845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fd3b0-b110-40f9-8ab2-7a78c13f2b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:31.145765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ba5fd3b0-b110-40f9-8ab2-7a78c13f2b9d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:31.146928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ba5fd3b0-b110-40f9-8ab2-7a78c13f2b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:31.210590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 591/1168] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:31.483461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c913f-ba7e-4074-83b0-d19a053d41df None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:31.507746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:31.582925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c913f-ba7e-4074-83b0-d19a053d41df None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:31.614671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:31.615260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:31.615536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:31.615822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:31.616487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:31.617836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2d2ab-0607-49c4-9a4f-a4339e2de843 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:31.633526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 578/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Thu Aug 18 16:29:31 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:29:33.541530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa3863-296f-4341-b8ae-87969f7f21c6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:33.542057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa3863-296f-4341-b8ae-87969f7f21c6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:33.542057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa3863-296f-4341-b8ae-87969f7f21c6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:33.543406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 592/1170] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:33.548667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:33.549048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:33.549222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:33.566752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:33.567927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:33.632343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 579/1171] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:33.901259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa3863-296f-4341-b8ae-87969f7f21c6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:33.953289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:33.998257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa3863-296f-4341-b8ae-87969f7f21c6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:34.031238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:34.031847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:34.032152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:34.032429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] PATH_INFO: `/v3/domains/1422279752fe427d912757704b1ba7e7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:34.042298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=1422279752fe427d912757704b1ba7e7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:34.043722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73835ea6-c80c-45c4-a915-caae3c0491ff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:34.045285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 593/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Thu Aug 18 16:29:33 2022] GET /identity/v3/domains/1422279752fe427d912757704b1ba7e7 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:34.050996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:34.065053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:34.147141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327436d7-134d-47f1-a44f-6ad3af895692 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:34.179637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:34.180223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:34.180506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:34.180781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:34.181421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:34.182834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f429b-9925-45eb-bd35-efc9b3ed759e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:34.208245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 580/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:29:34 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:29:36.107318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e106-7f53-417c-8084-864dac98daab None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:36.107837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e106-7f53-417c-8084-864dac98daab None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:36.107837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9e106-7f53-417c-8084-864dac98daab None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:36.109701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 594/1174] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:36.114898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:36.115313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:36.115430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:36.133267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:36.134425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:36.189937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:36.198597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 581/1175] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:36.464885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e106-7f53-417c-8084-864dac98daab None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:36.561794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9e106-7f53-417c-8084-864dac98daab None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:36.574062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:36.595035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:36.595647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:36.595926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:36.596232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] PATH_INFO: `/v3/domains/1422279752fe427d912757704b1ba7e7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:36.597325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1422279752fe427d912757704b1ba7e7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:36.598747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ef0af-7e8a-43e9-88cf-7b5b92db8c28 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:36.600299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 595/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Thu Aug 18 16:29:36 2022] GET /identity/v3/domains/1422279752fe427d912757704b1ba7e7 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:36.605925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:36.699722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5656ee-65ef-4f01-bd7c-63ad6ac44c3b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:36.732933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:36.733556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:36.733831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:36.734099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:36.734724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:36.736173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996bd68-334e-45b0-8d51-2ea7852627c1 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:36.756989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 582/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:29:36 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:29:38.670327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4019-4ea4-464d-a300-959d486c14f7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:38.670860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4019-4ea4-464d-a300-959d486c14f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:38.670860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b4019-4ea4-464d-a300-959d486c14f7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:38.672230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 596/1178] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:38.677264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:38.677653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:38.677818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:38.695349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:38.696562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:38.741626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:38.762972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 583/1179] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:39.026969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b4019-4ea4-464d-a300-959d486c14f7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:39.125780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b4019-4ea4-464d-a300-959d486c14f7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:39.158373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:39.158985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:39.159264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:39.159532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:39.169129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:39.173702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:39.174859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:29:39.175909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 597/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:39.180818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:39.276022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a4c2-018d-4aaf-b417-bdb6becc5fbb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:39.307785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:39.308342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:39.308623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:39.308897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:39.309549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:39.309851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:39.311698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:39.319415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 584/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:39.324863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:39.366025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:39.423031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928d6d-dc90-4f8b-a199-e463481b61b9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:39.455534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:39.456370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:39.456655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:39.456927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] PATH_INFO: `/v3/users/8d8efcf522b64ba3894298902a74865f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:39.469456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] RBAC: Authorizing `identity:get_user(user_id=8d8efcf522b64ba3894298902a74865f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:39.470890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:39.472498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 598/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/users/8d8efcf522b64ba3894298902a74865f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:39.478360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:39.520797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:39.575546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd27a-a646-4612-9450-b1c692d15bb9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:39.606674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:39.607272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:39.607553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:39.607824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:39.672276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:39.673706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:39.712915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:39.775100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 585/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:39.781678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:39.872579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:39.876290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e4e22-1be1-4788-a5d6-eba446f978b4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:39.909141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:39.909761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:39.910041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:39.910313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] PATH_INFO: `/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:39.911402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] RBAC: Authorizing `identity:get_project(project_id=3c71ce1a919d4e5c8dc72c19ff452b5e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:39.912847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614bb41-2604-4049-9d28-d3e14e82cd8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:39.914423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 599/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:39.920396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:40.015076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8e2b-c077-4b48-aa99-ef0bd644b114 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:40.049560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:40.050147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:40.050426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:40.050699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:40.051408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=3c71ce1a919d4e5c8dc72c19ff452b5e, user.id=8d8efcf522b64ba3894298902a74865f) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:40.051714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:40.053153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5f0b1-b7fc-4ec9-b8a2-0cd20a8d6f65 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:40.058307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 586/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:39 2022] GET /identity/v3/role_assignments?user.id=8d8efcf522b64ba3894298902a74865f&scope.project.id=3c71ce1a919d4e5c8dc72c19ff452b5e&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:41.912539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7f8bc-9275-438d-9d93-858060827552 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:41.913062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7f8bc-9275-438d-9d93-858060827552 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:41.913062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7f8bc-9275-438d-9d93-858060827552 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:41.914405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 600/1186] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:41.919798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:41.920264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:41.920357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:41.932942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:41.938279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:41.939437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:42.003216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 587/1187] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:42.274518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7f8bc-9275-438d-9d93-858060827552 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:42.370000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7f8bc-9275-438d-9d93-858060827552 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:42.402537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:42.403141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:42.403417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:42.403683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:42.413258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:42.417854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:42.418993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:29:42.420011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 601/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:42.425266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:42.518091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb82ff-5e2c-4366-94fd-a63c9e27768e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:42.550104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:42.550634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:42.550909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:42.551178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:42.551817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:42.552139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:42.553510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:42.555589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:42.562397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 588/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:42.568151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:42.594569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:42.663052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dce669-c085-4f9b-8c94-6716ec011eb5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:42.696167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:42.696773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:42.697049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:42.697316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] PATH_INFO: `/v3/users/8d8efcf522b64ba3894298902a74865f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:42.698400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] RBAC: Authorizing `identity:get_user(user_id=8d8efcf522b64ba3894298902a74865f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:42.699807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:42.701347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 602/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:42 2022] GET /identity/v3/users/8d8efcf522b64ba3894298902a74865f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:42.706943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:42.803375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83892d11-dca7-434a-a62c-d3b44250cee3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:42.834725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:42.835339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:42.835618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:42.835889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] PATH_INFO: `/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:42.837001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] RBAC: Authorizing `identity:get_project(project_id=3c71ce1a919d4e5c8dc72c19ff452b5e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:42.838412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e86a3-24cd-408c-9484-7d5030f28d59 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:42.840013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 589/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:42 2022] GET /identity/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:42.846441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:42.934346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:42.941231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eaef5-2c9c-48ac-b23a-3404d98a2259 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:42.973443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:42.974077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:42.974354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:42.974621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] PATH_INFO: `/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e/users/8d8efcf522b64ba3894298902a74865f/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:42.976486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c71ce1a919d4e5c8dc72c19ff452b5e, user_id=8d8efcf522b64ba3894298902a74865f, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:42.977974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f51234-1c4b-49f3-b1eb-3b305caef414 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:42.990363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 603/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:29:42 2022] PUT /identity/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e/users/8d8efcf522b64ba3894298902a74865f/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:29:44.843593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9c27-63d4-48a9-8d1f-70891cb28c84 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:44.844119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9c27-63d4-48a9-8d1f-70891cb28c84 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:44.844222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab9c27-63d4-48a9-8d1f-70891cb28c84 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:44.845512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 590/1193] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:29:44.850736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:44.851177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:44.851277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:44.869253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:29:44.870432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:29:44.933277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 604/1194] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:29:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:29:45.203606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab9c27-63d4-48a9-8d1f-70891cb28c84 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:45.267760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:45.303201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab9c27-63d4-48a9-8d1f-70891cb28c84 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:45.334872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:45.335486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:45.335767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:45.336042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:45.346233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:29:45.350877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:29:45.351957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:29:45.352875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 591/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:29:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:29:45.357924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:45.437897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:45.454544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f14946-e71b-4d46-9f19-dcc2108f34ea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:45.486759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:45.487351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:45.487632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:45.487905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:45.488586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:45.488891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:45.490239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:45.497887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 605/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:45.503990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:45.599750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c6c5-6197-4254-aa6e-e417b4e444de None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:45.624535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:45.633304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:45.633915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:45.634194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:45.634465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] PATH_INFO: `/v3/users/8d8efcf522b64ba3894298902a74865f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:45.635560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] RBAC: Authorizing `identity:get_user(user_id=8d8efcf522b64ba3894298902a74865f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:45.637040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:45.638604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 592/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Thu Aug 18 16:29:45 2022] GET /identity/v3/users/8d8efcf522b64ba3894298902a74865f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:45.644965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:45.741214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6aac7-278d-410f-b7ce-55454e73918b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:45.773590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:45.774195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:45.774477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:45.774750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:45.790505 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:45.841116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:45.842592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:45.935727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 606/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:29:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:29:45.942156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:46.037942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7d2f-aa3a-4461-8424-5095c0abe687 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:46.070127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:46.070736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:46.071016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:46.071290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] PATH_INFO: `/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:46.072404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=3c71ce1a919d4e5c8dc72c19ff452b5e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:46.073853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c50a6-8782-4090-9440-315b3f990fb8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:46.075444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 593/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Thu Aug 18 16:29:45 2022] GET /identity/v3/projects/3c71ce1a919d4e5c8dc72c19ff452b5e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:46.082166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:29:46.129049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:46.185779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030208e8-7505-4fc1-8d47-8ae1fc276506 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:29:46.217745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:29:46.218326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:29:46.218602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:29:46.218868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:29:46.219570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=3c71ce1a919d4e5c8dc72c19ff452b5e, user.id=8d8efcf522b64ba3894298902a74865f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:29:46.219872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:29:46.221331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722064e-5bf2-46a9-905e-657a4a6bf384 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:29:46.226753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 607/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:29:46 2022] GET /identity/v3/role_assignments?user.id=8d8efcf522b64ba3894298902a74865f&scope.project.id=3c71ce1a919d4e5c8dc72c19ff452b5e&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:29:56.066174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=69 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:29:56.224349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=45 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:41.733358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2b6a-f73c-4266-9da2-a2c6c168301a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:41.733358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2b6a-f73c-4266-9da2-a2c6c168301a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:41.733358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2b6a-f73c-4266-9da2-a2c6c168301a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:41.735240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 594/1201] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:30:41.741164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:41.742020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:41.742487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:41.761846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:30:41.763444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:30:41.880098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 608/1202] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:30:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:30:42.199102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be2b6a-f73c-4266-9da2-a2c6c168301a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:42.361864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be2b6a-f73c-4266-9da2-a2c6c168301a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:42.413402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:42.414852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:42.415625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:42.416216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:42.430374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:42.432522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:42.454458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:42.455813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:42.457185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:42.457185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:42.457185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:42.461591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:42.463803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 595/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:42.620610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f792822-a9c6-4899-8404-d0c97b79b7d0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:42.669123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:42.684770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:42.685603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:42.686042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:42.686320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:42.687065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:42.687375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:42.688877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9110b7f-3a74-48e6-88a1-c45015c8837d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:42.705973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 609/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:30:42.712979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:42.805352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:42.898701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c20fc6-e95d-4226-be2a-b7b9f98ccd16 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:42.939889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:42.940573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:42.940854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:42.941128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:42.941772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:42.943210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f01398-377c-41a4-8da4-86d312661e4f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:42.973505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 596/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Thu Aug 18 16:30:42 2022] POST /identity/v3/users => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:30:45.176589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8c22-2e3e-4372-9db1-3fc04f647c59 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:45.177200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8c22-2e3e-4372-9db1-3fc04f647c59 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:45.177200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8c22-2e3e-4372-9db1-3fc04f647c59 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:45.178440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 610/1206] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:30:45.187396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:45.187396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:45.187396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:45.203779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:30:45.205297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:30:45.276805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 597/1207] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:30:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:30:45.543680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d8c22-2e3e-4372-9db1-3fc04f647c59 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:45.662859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d8c22-2e3e-4372-9db1-3fc04f647c59 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:45.703999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:45.705235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:45.705235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:45.705440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:45.716418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:30:45.721884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:45.722943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:45.723927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 611/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:30:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:45.729092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:45.774908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:45.844326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c2e6c-97a0-4292-a7ec-81d3135f1a86 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:45.885718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:45.886380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:45.886709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:45.887008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:45.887668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:45.887977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:45.890445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:45.899056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 598/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:30:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:30:45.904871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:45.965690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:46.031007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c25d-0425-40ef-9778-8fe1654fca82 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:46.071983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:46.072729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:46.072972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:46.073302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:46.085425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:46.086916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:46.102745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:46.103767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:46.104691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:46.104691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:46.104691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:46.104691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 612/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:46.110550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:46.234284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:46.238370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9d5c-f836-4d9c-bd60-a602f8e4e391 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:46.284023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:46.284662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:46.284974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:46.285189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:46.285825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:46.286121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:46.287472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:46.303970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 599/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:46.309858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:46.415989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52ad7a-096a-415f-bc4e-7ad809874d28 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:46.417551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:46.454288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:46.454938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:46.455261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:46.455535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:46.464287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:46.465902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:30:46.478715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:46.479741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:46.480781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 613/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:30:46.489322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:46.605546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f060b-78a6-41e8-9f70-be5141bf1755 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:46.641988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:46.642604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:46.642873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:46.643174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:46.643890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:46.644220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:46.645635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:46.663940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 600/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:30:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:46.671242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:46.799011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc3aac-e080-4323-bf13-0b44dc20ae15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:46.844287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:46.844901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:46.845208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:46.845455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:46.877768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:46.918430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:46.920636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.032457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 614/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:30:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:30:47.038113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:47.061432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:47.162373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a48fb-a34e-4580-8443-01bd5562185d None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:47.200076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:47.200872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:47.201250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:47.201622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:47.215363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:47.218013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:47.232026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:47.233666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:47.235164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:47.235164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:47.235164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:47.235164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 601/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:47.239640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:47.309743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:47.349927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337adb0-69ed-497e-9e2e-d0bfb626fede None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:47.385448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:47.386061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:47.386335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:47.386604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:47.387243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:47.387542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:47.388981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.400893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 615/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:47.407208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:47.481265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:47.515918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af0ec-c5f9-4d57-8553-5a5fb906f659 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:47.550751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:47.551384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:47.551653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:47.551921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:47.559220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:47.560882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:30:47.573424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:47.574673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:47.575772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 602/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:47.580678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:47.690136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaadcf-03d0-41e8-ac8b-34782b441a62 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:47.722025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:47.740354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:47.741138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:47.741535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:47.741929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:47.742772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:47.743187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:47.744810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55be2-4650-47a2-a164-6ae6c90a2a4d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.760343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 616/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:47.767329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:47.886635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250615e-02d4-4969-8fa3-715aaf222f07 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:47.914725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:47.920519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:47.921113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:47.921491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:47.921782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:47.922546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=847ca98f731045cda90924197d3b800d) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:47.922817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:47.924245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859680-9c8e-4f81-a22b-216a82cf3b51 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:47.929555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 603/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:30:47 2022] GET /identity/v3/role_assignments?user.id=847ca98f731045cda90924197d3b800d&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:49.802399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9b00-fe3d-400c-ae02-e842369a932b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:49.802942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9b00-fe3d-400c-ae02-e842369a932b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:49.803041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9b00-fe3d-400c-ae02-e842369a932b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:49.804655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 617/1220] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:30:49.810276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:49.811107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:49.811381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:49.830775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:30:49.832296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:30:49.906608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 604/1221] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:30:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:30:50.170869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9b00-fe3d-400c-ae02-e842369a932b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:50.281874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9b00-fe3d-400c-ae02-e842369a932b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:50.319075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:50.320013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:50.320417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:50.320841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:50.331901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:30:50.336726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:50.337848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:50.339061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 618/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:30:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:50.343868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:50.451416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb138a-f06e-4d3c-908f-ae56bef0019e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:50.476574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:50.488867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:50.489469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:50.489749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:50.490021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:50.490684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:50.490975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:50.492367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:50.500878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 605/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:30:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:50.506815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:50.554820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:50.614330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195e58-c61b-4360-8307-11b5e3bd34c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:50.649152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:50.649898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:50.650181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:50.650518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:50.662395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:50.663907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:50.680106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:50.681313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:50.682426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:50.682426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:50.682426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:50.682426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 619/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:50.689232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:50.796698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf8335-b6bd-4ca9-8cbd-977bb4b67c50 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:50.832105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:50.832766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:50.832985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:50.833258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:50.833891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:50.834195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:50.835561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:50.847822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 606/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:50.853505 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:50.952711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:50.960323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf42d-1526-457a-8e75-e2b7fb596cda None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:50.995370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:50.995939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:50.996261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:50.996538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.004553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.005991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:30:51.017264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:51.023648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:51.024981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 620/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:30:51.025806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.073505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:51.130751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a61a98-c747-4858-ba57-b7c92a4fc92e None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:51.170438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:51.171166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:51.171537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:51.171897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.172742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:51.173216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.175008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.194766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 607/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:30:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:51.200465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.316178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad420-fc51-417a-bda8-69d5cdc6702f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:51.353407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:51.354224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:51.354589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:51.354872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.370135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.371586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:51.387101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:51.388320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:51.390271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:51.390271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:51.390271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:51.390271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 621/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:51.394743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.508911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7739-0725-4181-a4e5-0948d130ea79 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:51.511636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:51.545244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:51.545946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:51.546229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:51.546497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.547135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:51.547436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.548828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.561701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 608/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:51.567733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.576946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:51.673709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc6577-401d-4654-be38-f4a774476bc8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:51.709179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:51.709818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:51.710088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:51.710425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.718744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.721873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:30:51.731802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:51.733346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 622/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:51.739856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.842888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d94bc-002d-4572-acc7-a07880ea3230 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:51.880256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:51.880912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:51.881308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:51.881518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:51.882357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:51.882634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:51.884302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c931423-838b-4860-968e-0ee3c3fd5db6 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:51.896815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 609/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:51.902482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:51.969752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:52.005360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626f9cb-fc48-45b3-b50d-efb77e057d43 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:52.039636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:52.040349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:52.040606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:52.040874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/847ca98f731045cda90924197d3b800d/roles/f176d9d3a05f4cfb920a482c6b2ed5de` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:52.055523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=847ca98f731045cda90924197d3b800d, role_id=f176d9d3a05f4cfb920a482c6b2ed5de)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:52.056992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268967-e3eb-4a6e-8019-775f59c279da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:52.070977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 623/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:30:51 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/847ca98f731045cda90924197d3b800d/roles/f176d9d3a05f4cfb920a482c6b2ed5de => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:30:54.000882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ffe5-3784-4b43-95ee-9f02a37a6144 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:54.001417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ffe5-3784-4b43-95ee-9f02a37a6144 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:54.001417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ffe5-3784-4b43-95ee-9f02a37a6144 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:54.002700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 610/1233] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:30:54.008104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:54.008535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:54.008690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:54.027779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:30:54.030032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:30:54.101480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 624/1234] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:30:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:30:54.372453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ffe5-3784-4b43-95ee-9f02a37a6144 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:54.400445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:54.480182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ffe5-3784-4b43-95ee-9f02a37a6144 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:54.516453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:54.517080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:54.517361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:54.517637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:54.528410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:30:54.533185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:54.534318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:54.535413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 611/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Thu Aug 18 16:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:54.540352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:54.595914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:54.654303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6aa6d9-6355-4cbb-babc-402ea60dc374 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:54.691925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:54.692696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:54.693001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:54.693294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:54.693995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:54.694355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:54.695818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:54.704967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 625/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Thu Aug 18 16:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:54.710719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:54.806343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:54.824508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46adac-4121-4a11-8df4-6c1783b13df9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:54.859654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:54.860321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:54.860600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:54.860875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:54.870798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:54.872272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:54.887415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:54.888576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:54.889494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:54.889494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:54.889494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:54.894071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 612/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:30:54.895105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:54.995787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78be-d0b5-43c7-a97f-e50f444cdedb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:55.005576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:55.032086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:55.032786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:55.032972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:55.033237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:55.033871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:55.034167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:55.035517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:55.047072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 626/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:55.052965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:55.161084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699da3-561f-4509-aef2-b028695410d5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:55.197118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:55.197753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:55.198034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:55.198306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:55.201057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:55.205899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:55.207527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:30:55.219118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:55.220283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:55.221260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 613/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:55.226596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:55.335138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb0a9c-e167-4425-bafa-29388c0291c6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:55.370898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:55.371515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:55.371804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:55.372111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:55.373406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:55.373724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:55.375192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:55.392723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 627/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:30:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:55.398608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:55.505563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcf38d-76b4-4e7e-bdae-18634564ec21 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:55.547374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:55.548041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:55.548350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:55.548711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:55.617218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:55.625184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:55.626654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:55.736180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 614/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:30:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:30:55.742077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:55.770026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:55.842770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d65de0-79ec-4e3b-9c08-780fd523dbc6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:55.877475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:55.878132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:55.878732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:55.879067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:55.891096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:55.892915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:55.910674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:55.911825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:55.912809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:55.912809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:55.912809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:55.912809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 628/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:55.917943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:56.017567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:56.023572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f506cd-2ebb-4398-8e52-00072a7c64bc None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:56.059334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:56.060028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:56.060281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:56.060551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:56.061270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:56.061517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:56.062882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:56.074982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 615/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:56.081355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:56.169246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:56.193112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71f219-6bef-44f8-8f2e-4f5d37b49e3e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:56.233642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:56.234288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:56.234568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:56.234836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:56.241866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:56.243382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:30:56.257751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:56.258932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:30:56.260007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 629/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:56.265912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:56.379288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfc46d-d375-4ae4-b7e9-a03437edd2eb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:56.414736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:56.415531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:56.415892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:56.416304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:56.417156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:56.417478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:56.419189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b112ca-9fd9-4f32-909b-95a7bc408910 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:56.434847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 616/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:30:56.441774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:56.553674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353d79-5223-4f62-b288-78c09025d72e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:56.589938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:56.590699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:56.591042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:56.591245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:56.592755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] RBAC: Adding query filter params (role.id=f176d9d3a05f4cfb920a482c6b2ed5de, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=847ca98f731045cda90924197d3b800d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:56.593155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:56.594589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1faf-ffc3-48e9-82eb-9af769717ff7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:56.601573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 630/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:30:56 2022] GET /identity/v3/role_assignments?user.id=847ca98f731045cda90924197d3b800d&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f176d9d3a05f4cfb920a482c6b2ed5de => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:58.623926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0ff89-db02-4263-9da9-676679c2d229 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:58.624498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0ff89-db02-4263-9da9-676679c2d229 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:58.624498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0ff89-db02-4263-9da9-676679c2d229 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:58.625845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 617/1247] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:30:58.631466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:58.631917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:58.632013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:58.638332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:58.651985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:30:58.652207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:30:58.726524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 631/1248] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:30:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:30:58.989945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0ff89-db02-4263-9da9-676679c2d229 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.009463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:59.101786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0ff89-db02-4263-9da9-676679c2d229 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:59.139567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:59.140247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:59.140526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:59.140797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:59.154049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:30:59.160619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:59.161674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:59.162822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 618/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:30:59.170170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.283635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c9b08-aef8-424e-ad6a-91023fa0f8a4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:59.314686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:59.322209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:59.322794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:59.323070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:59.324075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:59.324885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:59.325225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:59.326863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:59.340096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 632/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:30:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:59.342364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.424933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:59.449517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb339-019d-4cbd-9007-46f547dae9ea None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:59.486854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:59.487572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:59.487995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:59.488410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:59.502024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:59.504399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:30:59.522915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:59.524192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:30:59.525227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:30:59.525227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:30:59.525227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:59.525227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 619/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:59.531849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.647465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a75d8-23b0-4f49-9e57-ddd753c0f169 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:59.692419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:59.693025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:59.693308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:59.693577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:59.694202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:30:59.694500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:59.695869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:59.708378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 633/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:30:59.714261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.830105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de301d0f-c5bf-4e63-8371-3389f25c38b3 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:30:59.864628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:30:59.874160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:30:59.874784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:30:59.875075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:30:59.875334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:30:59.884518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:30:59.886080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:30:59.899919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:30:59.900939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:30:59.901914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 620/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:30:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:30:59.910628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:30:59.974997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:00.021585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e33d07-11f3-4f6d-ba2b-96612423ab13 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:00.057235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:00.057861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:00.058146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:00.058424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:00.059187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:00.059499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:00.061467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:00.082747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 634/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:30:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:00.088708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:00.209071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381af2c-6444-4700-9025-23cd8ed02965 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:00.246261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:00.246859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:00.247136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:00.247410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:00.312122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:00.327782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:00.329272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:00.437677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 621/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:31:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:31:00.443496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:00.547120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3aa4-95bd-4d6c-b644-0c0ad8e8aa37 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:00.560229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:00.581821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:00.582449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:00.582723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:00.582982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:00.593039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:00.594504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:31:00.609331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:00.610346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:31:00.611298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:31:00.611298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:00.611298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:00.611298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 635/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:31:00.616290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:00.708515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:00.725476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7790fe-35ed-4838-ad47-99c52ae6dcd8 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:00.762761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:00.763855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:00.764171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:00.764441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:00.765095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:00.765374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:00.766699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:00.778051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 622/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:00.784112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:00.894045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dafcd-1b26-46dd-b6a9-e950b314b708 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:00.930352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:00.931023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:00.931327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:00.931600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:00.938986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:00.940533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:31:00.951618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:00.957502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:00.958848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 636/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:00.959574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:01.064254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0b03f-74ed-4c15-ab01-c04f3af5d95f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:01.098415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:01.099015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:01.099291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:01.099560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:01.100269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:01.100568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:01.101988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b9bd-81b2-42b2-984e-98cb3265ad60 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:01.114604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 623/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:31:01.121614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:01.152880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:01.236081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047419b9-f486-44bf-903a-0fc81df61b71 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:01.271448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:01.272050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:01.272351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:01.272670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:01.273522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=847ca98f731045cda90924197d3b800d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:01.273900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:01.275544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81a8d-2b48-4525-8aea-929df9b9551e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:01.285049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 637/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:31:01 2022] GET /identity/v3/role_assignments?user.id=847ca98f731045cda90924197d3b800d&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:31:03.171416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7081b-5f41-4b64-90f9-94ca7cfcf442 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:03.171941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7081b-5f41-4b64-90f9-94ca7cfcf442 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:03.171941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7081b-5f41-4b64-90f9-94ca7cfcf442 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:03.173364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 624/1261] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:03.178261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:03.178674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:03.178789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:03.196682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:03.197847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:03.260855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 638/1262] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:03.528969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7081b-5f41-4b64-90f9-94ca7cfcf442 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:03.539615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:03.626441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7081b-5f41-4b64-90f9-94ca7cfcf442 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:03.658062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:03.658668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:03.658943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:03.659209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:03.669021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:31:03.674149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:03.675271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:03.676491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 625/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:03.681032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:03.698984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:03.776016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762ea9-b6be-4dac-a6bd-963b193c28bd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:03.808831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:03.809369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:03.809654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:03.809925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:03.810577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:03.810877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:03.812255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:03.819842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 639/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:03.825394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:03.889339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:03.922089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fda8-1772-445f-9640-5b1e18351794 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:03.954997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:03.955609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:03.955889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:03.956191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:03.965890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:03.967871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:31:03.981684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:03.983338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:31:03.984391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:31:03.984391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:03.984391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:03.984391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 626/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:03.988984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.066240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:04.084466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42333335-f1af-456f-ac44-342f4b4a5ede None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.116631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.117212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.117487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.117753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.118373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:04.118668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.120005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.131849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 640/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:04.140232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.249656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43d3b6-2e2e-4801-b97f-155574ae6ceb None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.282600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:04.296550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.297172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.297451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.297720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.304838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.306267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:31:04.316905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:04.317997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:04.318967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 627/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:04.323719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.419266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ce827-ec7b-4e69-a901-b91e14179007 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.451296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.451939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.452249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.452521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.453236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:04.453539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.454942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.463094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:04.472025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 641/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:04.477513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.572496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876ed5-68c1-4cd1-a3c3-7ae65d4e01b4 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.604981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.605593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.605875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.606149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.616231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.617664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:31:04.631943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:04.633005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:31:04.634306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:31:04.634306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:04.634306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:04.634306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 628/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:04.639295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.734732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6c09a-307d-4b29-aec8-9d24291e8716 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.767858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.768476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.768756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.769033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.769666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:04.769967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.771323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.782073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 642/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:04.787718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.818634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:04.885495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005ae-d95d-47f1-a674-83e0c1b3b03b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:04.916815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:04.917415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:04.917690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:04.917956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:04.924706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:04.926119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:31:04.937262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:04.938312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:04.939408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 629/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:04.944076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:04.998982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:05.038217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c34410-fcb8-485a-9ff3-c94d1fdd056a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:05.070168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:05.070750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:05.071025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:05.071292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:05.071962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:05.072295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:05.073702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c5320-e658-429f-b796-b151f536c203 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:05.084890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 643/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:05.090798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:05.185337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:05.194582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415aea4-d59d-4645-a321-fcac41e0870f None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:05.226372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:05.227011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:05.227287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:05.227556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] PATH_INFO: `/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/847ca98f731045cda90924197d3b800d/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:05.229429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed88e5eaffef49d881b15eea4f3eadfb, user_id=847ca98f731045cda90924197d3b800d, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:05.230845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428919f-c495-46ef-ad23-f387a51bc545 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:05.243479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 630/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Thu Aug 18 16:31:05 2022] PUT /identity/v3/projects/ed88e5eaffef49d881b15eea4f3eadfb/users/847ca98f731045cda90924197d3b800d/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:31:07.094766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835c7b-7788-4100-93d4-1a07be53588f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:07.095264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835c7b-7788-4100-93d4-1a07be53588f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:07.095264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f835c7b-7788-4100-93d4-1a07be53588f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:07.096563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 644/1274] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:07.101509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:07.101880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:07.102056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:07.119442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:07.120649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:07.194536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 631/1275] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:07.461440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835c7b-7788-4100-93d4-1a07be53588f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:07.559497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f835c7b-7788-4100-93d4-1a07be53588f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:07.576553 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:07.592887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:07.593497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:07.593770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:07.594035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:07.603507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:31:07.608702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:07.609815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:07.610691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 645/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Thu Aug 18 16:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:07.615592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:07.692647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:07.710743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650522c0-58c0-45c7-ad46-58f0779ccc54 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:07.743698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:07.744317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:07.744592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:07.744862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:07.745505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:07.745800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:07.747154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:07.755081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 632/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Thu Aug 18 16:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:07.760792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:07.855798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2e6e-b423-40bd-9a66-5aaa8d293047 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:07.887832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:07.888459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:07.889251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:07.889521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:07.899382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:07.900836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:31:07.914713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:07.915825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:31:07.916986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:31:07.916986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:07.916986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:07.916986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 646/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:07.921631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.016502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8c43a-9ced-4362-abed-5def6e9c4baf None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.048174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.048752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.049028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.049299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.049920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:08.050218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.051557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.062692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 633/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:08.068250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.098852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:08.166946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6c3f-fa9e-40ec-a04b-c06b662ea67a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.198646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.199263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.199544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.199817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.207431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.208896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:31:08.220096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:08.221213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:08.222215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 647/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:08.227121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.230886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:08.330828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34899-3e04-4abd-804d-65d4bd6b1f93 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.362596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.363190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.363469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.363740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.364497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:08.364803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.366224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.383115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 634/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Thu Aug 18 16:31:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:08.389528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.476655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:08.486559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5e4-4932-4fde-a824-ee23cec99ed7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.519730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.520349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.520634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.520907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.584800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.586173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.670641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:08.681032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 648/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Thu Aug 18 16:31:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:31:08.687455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.749475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:08.786307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869bc42-2d18-4129-90d8-45cd39bb3737 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.819942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.820588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.820869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.821142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.830697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.832165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:31:08.846118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:08.847244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:31:08.848419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:31:08.848419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:31:08.848419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:08.848419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 635/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:08.852959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:08.949433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff4e2-b08d-439b-831c-aca1036dbb55 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:08.981656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:08.982794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:08.983074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:08.983344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:08.983983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:08.984313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:08.985669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:08.996477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 649/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Thu Aug 18 16:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:09.002516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:09.097622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ece41-9421-4ae4-8364-95134ff00f4b None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:09.111062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:09.132905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:09.133721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:09.134121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:09.134528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:09.143404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:09.145331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:31:09.157890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:09.158897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: ERROR keystone.server.flask.application Aug 18 16:31:09.160224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 636/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Thu Aug 18 16:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:09.164809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:09.213004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:09.262688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a266ee4-ec7c-492e-b474-ff2e105de754 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:09.294722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:09.295894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:09.296217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:09.296491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:09.297174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:09.297479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:09.298904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1242ce9-bbd0-482d-b9a9-ed947ec2a9f2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:09.310279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 650/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Thu Aug 18 16:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:09.316475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:09.412672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d8e0-53fe-42f4-81f7-07cb8839b2b5 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:09.443990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:09.444602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:09.444880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:09.445150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:09.445856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] RBAC: Adding query filter params (role.id=f6300a9e15d04a299f9847938352da84, scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb, user.id=847ca98f731045cda90924197d3b800d) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:09.446161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:09.447574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63242c5-3a06-4513-bbd2-7b40728b1bca None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:09.453657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 637/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Thu Aug 18 16:31:09 2022] GET /identity/v3/role_assignments?user.id=847ca98f731045cda90924197d3b800d&scope.project.id=ed88e5eaffef49d881b15eea4f3eadfb&role.id=f6300a9e15d04a299f9847938352da84 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:11.341868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2a53-f1c8-4c36-88c1-5dd569d2460d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:11.342399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2a53-f1c8-4c36-88c1-5dd569d2460d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:11.342399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2a53-f1c8-4c36-88c1-5dd569d2460d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:11.343713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 651/1288] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:11.348664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:11.349083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:11.349223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:11.367024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:11.368238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:11.397747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:11.433699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 638/1289] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:11.699559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2a53-f1c8-4c36-88c1-5dd569d2460d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:11.797446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2a53-f1c8-4c36-88c1-5dd569d2460d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:11.807587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:11.830840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:11.831459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:11.831739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:11.832010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:11.832620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:11.833970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:11.842471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:11.843672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:11.844766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 652/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:31:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:11.849469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:11.944882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866f509-4354-44f0-9900-ebcf7c69dccb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:11.976860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:11.977393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:11.977672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:11.977945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:11.978564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:11.978867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:11.980247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1a47b-91dd-4d6c-9cd7-53948324aba3 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:11.985420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 639/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Thu Aug 18 16:31:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:11.990927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:12.086273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182251ee-31ab-4ada-9c86-672e16009794 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:12.118634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:12.119220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:12.119499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:12.119769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:12.120408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:12.120711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:12.122057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4c5e-c9b7-4a91-9083-4d807a1ecb10 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:12.126299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 653/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Thu Aug 18 16:31:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:13.979952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca43ae-289e-4d64-8347-4da68fb49bec None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:13.980509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca43ae-289e-4d64-8347-4da68fb49bec None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:13.980509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca43ae-289e-4d64-8347-4da68fb49bec None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:13.981812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 640/1293] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:13.987486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0760-4b37-4980-a447-2f9201b79ea2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:13.987882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0760-4b37-4980-a447-2f9201b79ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:13.988038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d0760-4b37-4980-a447-2f9201b79ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:14.006543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-744d0760-4b37-4980-a447-2f9201b79ea2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:14.007716 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-744d0760-4b37-4980-a447-2f9201b79ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:14.035654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:14.072377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 654/1294] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:14.347299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca43ae-289e-4d64-8347-4da68fb49bec None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:14.377824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:14.445559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca43ae-289e-4d64-8347-4da68fb49bec None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:14.478569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:14.479159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:14.479442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:14.479717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:14.480374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:14.481731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904855c-e803-4d5f-a174-c4e4eee5ebd2 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:14.495961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 641/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Thu Aug 18 16:31:14 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:31:16.369255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97aaf-4e65-424f-a762-10908c52a639 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:16.369815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97aaf-4e65-424f-a762-10908c52a639 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:16.369815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97aaf-4e65-424f-a762-10908c52a639 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:16.371122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 655/1296] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:16.376789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:16.377236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:16.377340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:16.395315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:16.396520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:16.465135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 642/1297] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:16.731943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e97aaf-4e65-424f-a762-10908c52a639 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:16.830419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e97aaf-4e65-424f-a762-10908c52a639 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:16.864001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:16.864640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:16.864921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:16.865191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:16.865763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:16.867109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:16.875498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:16.876897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:16.878155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 656/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:31:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:16.882810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:16.901256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:16.978713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca595b5-c434-4178-abc9-39ba31308375 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:17.010842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:17.011381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:17.011659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:17.011929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:17.012569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:17.012870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:17.014751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:17.019668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 643/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Thu Aug 18 16:31:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:17.025423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:17.056184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:17.121560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbe54c-5f72-471b-a1d3-770fdbaa5f45 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:17.162875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:17.163638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:17.164182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:17.164496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:17.165596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] RBAC: Adding query filter params (interface=public, service_id=9009cec943d4416da7c21e4dac24aff6, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:17.165914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:17.167896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a95e-8818-4a16-97a5-91b0ed7fad9d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:17.174957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 657/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Thu Aug 18 16:31:17 2022] GET /identity/v3/endpoints?service_id=9009cec943d4416da7c21e4dac24aff6&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:17.180957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:17.263050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:17.281451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93fd4-ad2c-4446-a92b-73dd7fb1f4c9 None admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:17.313030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:17.313621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:17.313896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:17.314163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:17.314746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:17.316117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb14a6f-dc50-42ad-976c-eaa5a56d45bc None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:17.322655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 644/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Thu Aug 18 16:31:17 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:31:19.194953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977acf5-81e5-4e7f-92c5-63b6695ee2c1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:19.195497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977acf5-81e5-4e7f-92c5-63b6695ee2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:19.195497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977acf5-81e5-4e7f-92c5-63b6695ee2c1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:19.196846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 658/1302] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:31:19.202432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:19.202864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:19.202966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:19.220915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:31:19.222076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:31:19.285952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 645/1303] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:31:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:31:19.554236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977acf5-81e5-4e7f-92c5-63b6695ee2c1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:19.646306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:19.653786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977acf5-81e5-4e7f-92c5-63b6695ee2c1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:19.686064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:19.686677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:19.686956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:19.687223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:19.687788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:19.689209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:31:19.697578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:31:19.698753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 18 16:31:19.699791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 659/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Thu Aug 18 16:31:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:31:19.705233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:19.778781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:19.800930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad0f4a-a59c-4193-9e45-94c37391428b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:19.834232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:19.834773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:19.835048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:19.835315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] PATH_INFO: `/v3/services` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:19.835931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:31:19.836259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:19.837603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd451-f854-4d57-a6df-eaf2d4b1f70e None admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:19.842509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 646/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Thu Aug 18 16:31:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:31:19.848341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:31:19.944823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d989ae-a07b-4860-abfb-9e72b80d0599 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:31:19.976234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:31:19.976823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:31:19.977105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:31:19.977378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:31:19.978032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:31:19.979384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702a6d-767a-4419-91f6-23a919107aaa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:31:19.998836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 660/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:31:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:31:29.839580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=30 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:31:29.994230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:22.896779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9678-cc52-4bf4-8f6b-ab77fc62885f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:22.897269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9678-cc52-4bf4-8f6b-ab77fc62885f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:22.897269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe9678-cc52-4bf4-8f6b-ab77fc62885f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:22.902275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 647/1307] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:22.903556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e518-64f4-47e5-bbc0-9eaa919d706f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:22.903965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e518-64f4-47e5-bbc0-9eaa919d706f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:22.904171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e518-64f4-47e5-bbc0-9eaa919d706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:23.009474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a266e518-64f4-47e5-bbc0-9eaa919d706f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:23.010683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a266e518-64f4-47e5-bbc0-9eaa919d706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:23.162762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 661/1308] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:32:23.457229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:23.457615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:23.457980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:23.459395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 648/1309] 10.222.0.73 () {54 vars in 965 bytes} [Thu Aug 18 16:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:23.465615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3ae29-120b-4403-825c-8914bdb9c9bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:23.466121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3ae29-120b-4403-825c-8914bdb9c9bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:23.466470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3ae29-120b-4403-825c-8914bdb9c9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:23.544254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1db3ae29-120b-4403-825c-8914bdb9c9bd None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:23.545486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1db3ae29-120b-4403-825c-8914bdb9c9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:23.566832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:23.632812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 662/1310] 10.222.0.73 () {58 vars in 1062 bytes} [Thu Aug 18 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:23.641935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:23.643704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:23.768610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0104a92-e3c3-44b9-be4a-500eb484a91c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:23.846414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:23.847017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:23.847290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:23.847555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:23.849142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:23.906333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:23.963107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:23.964673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd200c-9db6-4481-9027-bd8c1f553ab0 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:23.985224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 649/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:26.161477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:26.161977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:26.162082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:26.163495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 663/1312] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:26.168454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7228-5799-4c3d-8f5e-a087fe906642 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:26.168879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7228-5799-4c3d-8f5e-a087fe906642 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:26.169068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7228-5799-4c3d-8f5e-a087fe906642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:26.241385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5f1b7228-5799-4c3d-8f5e-a087fe906642 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:26.242616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5f1b7228-5799-4c3d-8f5e-a087fe906642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:26.357479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 650/1313] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:26.623319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:26.625541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:26.731733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1970b8-e1cf-4d62-9b76-a48663f99166 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:26.805983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:26.808604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:26.809382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:26.809833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:26.810207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:26.812792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:26.918554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:26.919985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19379e8d-9b65-4fbe-bf9e-2ebdd010d4b1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:26.938831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 664/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:29.153536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:29.154091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:29.154091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:29.156045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 651/1315] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:29.161172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428836f-9fbe-47e7-888d-8bd73afab758 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:29.161566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428836f-9fbe-47e7-888d-8bd73afab758 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:29.161726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428836f-9fbe-47e7-888d-8bd73afab758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:29.226112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a428836f-9fbe-47e7-888d-8bd73afab758 None None] MFA Rules not processed for user `e11a64b92c2c4ad19b9140c791184bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:29.227332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a428836f-9fbe-47e7-888d-8bd73afab758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:29.278142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:29.322250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 665/1316] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:29.610292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:29.611837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:29.621509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:29.715284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f2c0f-d690-459f-9a23-2883509285d9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:29.786776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:29.787373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:29.787651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:29.787921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:29.789524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:29.850133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:29.897236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:29.898666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570af39f-97fb-462e-859d-2a6c381a741d service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:29.916507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 652/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:32.330481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:32.331017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:32.331017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:32.332430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 666/1318] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:32.337509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e67ce-d75b-4c9d-a617-05992e487c86 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:32.337892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e67ce-d75b-4c9d-a617-05992e487c86 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:32.338053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e67ce-d75b-4c9d-a617-05992e487c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:32.401405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5a3e67ce-d75b-4c9d-a617-05992e487c86 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:32.402580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5a3e67ce-d75b-4c9d-a617-05992e487c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:32.494544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 653/1319] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:32.784187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:32.785730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:32.888039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde540f0-aec8-4d36-a680-6a6ff7f510fc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:32.960982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:32.961606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:32.961885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:32.962154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:32.963738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:32.971892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:33.070059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:33.071444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb8a5c-945f-455a-a035-f27e2793a507 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:33.090168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 667/1320] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:35.639582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fff0e-b332-474f-bf44-8e6345d54e99 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:35.640165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fff0e-b332-474f-bf44-8e6345d54e99 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:35.640165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fff0e-b332-474f-bf44-8e6345d54e99 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:35.641500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 654/1321] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:35.646579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771f23-4f05-433b-8ca5-a64ce2bcb17f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:35.647018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771f23-4f05-433b-8ca5-a64ce2bcb17f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:35.647122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771f23-4f05-433b-8ca5-a64ce2bcb17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:35.711719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91771f23-4f05-433b-8ca5-a64ce2bcb17f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:35.712965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91771f23-4f05-433b-8ca5-a64ce2bcb17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:35.775267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:35.816511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 668/1322] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:36.116636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:36.116939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:36.117208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:36.118540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 655/1323] 10.222.0.73 () {54 vars in 965 bytes} [Thu Aug 18 16:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:36.125043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cfab-cad9-48c1-9376-f22e04ed7e35 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:36.125333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cfab-cad9-48c1-9376-f22e04ed7e35 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:36.125607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cfab-cad9-48c1-9376-f22e04ed7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:36.201287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4a99cfab-cad9-48c1-9376-f22e04ed7e35 None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:36.202487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4a99cfab-cad9-48c1-9376-f22e04ed7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:36.277129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 669/1324] 10.222.0.73 () {58 vars in 1062 bytes} [Thu Aug 18 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:32:36.286597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:36.288142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:36.308118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:36.393690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4997fb-d8a8-49a7-894f-290fee5d4a9e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:36.468574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:36.469176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:36.469450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:36.469717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:36.471277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:36.550622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:36.587762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:36.589218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2da514-0cda-4721-9262-dfa7c6dcd14b service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:36.606840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 656/1325] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:38.776822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:38.777357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:38.777357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:38.778708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 670/1326] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:38.784493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989facf7-a590-45f1-b6ce-f0d7bfc50da4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:38.784877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989facf7-a590-45f1-b6ce-f0d7bfc50da4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:38.785031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989facf7-a590-45f1-b6ce-f0d7bfc50da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:38.848738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-989facf7-a590-45f1-b6ce-f0d7bfc50da4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:38.849921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-989facf7-a590-45f1-b6ce-f0d7bfc50da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:38.955189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 657/1327] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:39.240306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:39.241847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:39.300800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:39.344032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b4b8a-69fa-4f4a-9635-091ad022de09 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:39.417250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:39.417855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:39.418136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:39.418410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:39.420526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:39.528051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:39.530382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:39.532348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcc721-af0b-4221-a91c-c003c11fcdf3 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:39.551133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 671/1328] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:41.522733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:41.523278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:41.523278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:41.524673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 658/1329] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:41.530685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6d14f-a44d-4db0-9eb0-1ea193e6cc1e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:41.531218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6d14f-a44d-4db0-9eb0-1ea193e6cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:41.531518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6d14f-a44d-4db0-9eb0-1ea193e6cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:41.604295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c9a6d14f-a44d-4db0-9eb0-1ea193e6cc1e None None] MFA Rules not processed for user `e11a64b92c2c4ad19b9140c791184bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:41.605750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c9a6d14f-a44d-4db0-9eb0-1ea193e6cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:41.700104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 672/1330] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:41.979316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:41.980868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:42.012605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:42.089052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd34b0-2065-448a-bdb6-37ef8bdc0f0c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:42.166258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:42.166867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:42.167142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:42.167412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:42.169047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:42.248312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:42.285290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:42.286729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34543021-7eca-4232-9802-8bbe2dedb6a7 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:42.305050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 659/1331] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:44.596614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:44.597228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:44.597228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:44.598517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 673/1332] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:44.603616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284590de-9559-4668-836a-55c39345ddae None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:44.604038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284590de-9559-4668-836a-55c39345ddae None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:44.604198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284590de-9559-4668-836a-55c39345ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:44.668909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-284590de-9559-4668-836a-55c39345ddae None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:44.670609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-284590de-9559-4668-836a-55c39345ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:44.764675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 660/1333] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:45.044583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:45.046721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:45.113471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:45.146514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fc2ee-eca7-46c1-a8f7-42294bf8730e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:45.217794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:45.218395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:45.218671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:45.218936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:45.220534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:45.326210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:45.327580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc520c-c6f9-4756-8f43-28d96128054e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:45.337306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:45.346072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 674/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:47.265109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:47.265706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:47.265706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:47.266979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 661/1335] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:47.272044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa54d-d6ff-455b-b80c-e4f2c7ff15cd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:47.272521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa54d-d6ff-455b-b80c-e4f2c7ff15cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:47.272624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fa54d-d6ff-455b-b80c-e4f2c7ff15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:47.336256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8f0fa54d-d6ff-455b-b80c-e4f2c7ff15cd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:47.337463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f0fa54d-d6ff-455b-b80c-e4f2c7ff15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:47.430915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 675/1336] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:47.722051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:47.723620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:47.762307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:47.824492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4132-3361-4150-9a2f-f3ad231e96a6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:47.896801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:47.897399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:47.897677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:47.897946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:47.899504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:47.981105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:48.006980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:48.008447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b89a5-58ff-4036-b0c9-9ef86597596e service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:48.026238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 662/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:50.242143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:50.242701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:50.242701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:50.244033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 676/1338] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:50.249197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb27a6-4212-4500-bcda-cda509431691 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:50.249623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb27a6-4212-4500-bcda-cda509431691 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:50.249733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb27a6-4212-4500-bcda-cda509431691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:50.313716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-24eb27a6-4212-4500-bcda-cda509431691 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:50.314906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24eb27a6-4212-4500-bcda-cda509431691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:50.407431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 663/1339] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:50.686272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:50.687839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:50.761718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:50.790043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c2e23-a50a-41b5-91a3-95f5eb41890e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:50.860225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:50.860829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:50.861106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:50.861437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:50.863004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:50.974629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:50.975970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb771b39-6a2e-4662-a57a-416a31a83e35 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:50.993692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 677/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:54.774354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:54.774854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:54.775102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:54.776652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 664/1341] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:54.782015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc0b0f-6ff2-4fa2-9351-4db3be89d78c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:54.782460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc0b0f-6ff2-4fa2-9351-4db3be89d78c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:54.782584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc0b0f-6ff2-4fa2-9351-4db3be89d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:54.788122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:54.851580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bacc0b0f-6ff2-4fa2-9351-4db3be89d78c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:54.852815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bacc0b0f-6ff2-4fa2-9351-4db3be89d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:54.951144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 678/1342] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:55.236274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:55.237812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:55.286097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:55.340909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606211b4-8155-4a4f-951f-68d1d1bcdf76 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:55.413653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:55.414261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:55.414539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:55.414813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:55.416417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:55.508376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:55.524783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:55.526233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8032b4-4765-4911-bb94-399fe6e65bc4 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:55.546959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 665/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:32:58.073123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:58.073660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:58.073660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:58.074987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 679/1344] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:32:58.081430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d623f3-827c-454b-a3b6-382f630ec110 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:58.081942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d623f3-827c-454b-a3b6-382f630ec110 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:58.081942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d623f3-827c-454b-a3b6-382f630ec110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:58.149868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-33d623f3-827c-454b-a3b6-382f630ec110 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:32:58.151064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-33d623f3-827c-454b-a3b6-382f630ec110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:58.245601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 666/1345] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:32:58.529887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:32:58.531428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:58.619496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:32:58.638253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e650-8758-460d-b4a2-267347e7a029 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:32:58.711600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:32:58.712242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:32:58.712523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:32:58.712825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:32:58.714951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:32:58.833230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:32:58.834710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a95cec-9262-4295-a4a3-9f5de0279435 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:32:58.852419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 680/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:02.690192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:02.690694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:02.690776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:02.693345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 667/1347] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:02.697614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0409-9bde-4b09-8f32-8284113d21ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:02.698066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0409-9bde-4b09-8f32-8284113d21ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:02.698232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa0409-9bde-4b09-8f32-8284113d21ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:02.713720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:02.770443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f8fa0409-9bde-4b09-8f32-8284113d21ec None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:02.771674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f8fa0409-9bde-4b09-8f32-8284113d21ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:02.876994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 681/1348] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:03.160570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:03.162096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:03.221609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:03.267887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadcd18-bc9c-4f24-bd7a-cc94fd165923 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:03.342756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:03.343364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:03.343645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:03.343922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:03.345544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:03.450477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:03.455120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:03.456597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9102-bb2c-425f-ac17-2e5c1f6a4f96 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:03.474847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 668/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:08.412130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa00d6-30c5-40a6-bded-a47af254a702 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:08.412657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa00d6-30c5-40a6-bded-a47af254a702 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:08.412657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa00d6-30c5-40a6-bded-a47af254a702 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:08.414279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 682/1350] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:08.419709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ba888-c90f-4537-8909-3663e9b33677 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:08.419709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ba888-c90f-4537-8909-3663e9b33677 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:08.420726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ba888-c90f-4537-8909-3663e9b33677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:08.549584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1b4ba888-c90f-4537-8909-3663e9b33677 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:08.551200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1b4ba888-c90f-4537-8909-3663e9b33677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:08.677944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 669/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:33:12.846448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410dcb0-9fae-42a9-a3b5-e4054b370153 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:12.846978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410dcb0-9fae-42a9-a3b5-e4054b370153 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:12.846978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410dcb0-9fae-42a9-a3b5-e4054b370153 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:12.848587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 683/1352] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:12.853410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643828-294d-4123-bdd4-79b25ebe771e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:12.854230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643828-294d-4123-bdd4-79b25ebe771e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:12.854703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643828-294d-4123-bdd4-79b25ebe771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:12.874788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=59 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:12.911448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:12.934797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-40643828-294d-4123-bdd4-79b25ebe771e None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:12.936647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-40643828-294d-4123-bdd4-79b25ebe771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:13.049504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 670/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:14.305280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c945d-513a-4531-80f7-31a6b3fdd814 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:14.305780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c945d-513a-4531-80f7-31a6b3fdd814 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:14.305864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c945d-513a-4531-80f7-31a6b3fdd814 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:14.307177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 684/1354] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:14.312636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2125-4c48-4919-b29c-19dca82ef022 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:14.313096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2125-4c48-4919-b29c-19dca82ef022 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:14.313203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2125-4c48-4919-b29c-19dca82ef022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:14.389472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3f7b2125-4c48-4919-b29c-19dca82ef022 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:14.391165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3f7b2125-4c48-4919-b29c-19dca82ef022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:14.439308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:14.504786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 671/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:17.749568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f2f5-8ba2-4a6d-8320-4b757c7f0f8b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:17.750070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f2f5-8ba2-4a6d-8320-4b757c7f0f8b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:17.750176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f2f5-8ba2-4a6d-8320-4b757c7f0f8b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:17.751440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 685/1356] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:17.760816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c6eb3-75b1-484b-a2f7-0a2e7766d2b2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:17.760816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c6eb3-75b1-484b-a2f7-0a2e7766d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:17.760816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c6eb3-75b1-484b-a2f7-0a2e7766d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:17.834268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f23c6eb3-75b1-484b-a2f7-0a2e7766d2b2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:17.835448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f23c6eb3-75b1-484b-a2f7-0a2e7766d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:17.978866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 672/1357] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:18.279410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:18.280223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:18.280726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:18.282543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 686/1358] 10.222.0.73 () {54 vars in 962 bytes} [Thu Aug 18 16:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:18.290729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d8be-899f-4852-94aa-91760bff1882 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:18.291126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d8be-899f-4852-94aa-91760bff1882 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:18.291318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8d8be-899f-4852-94aa-91760bff1882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:18.309911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:18.373748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-31d8d8be-899f-4852-94aa-91760bff1882 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:18.374941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-31d8d8be-899f-4852-94aa-91760bff1882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:18.494816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 673/1359] 10.222.0.73 () {58 vars in 1059 bytes} [Thu Aug 18 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:18.502616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:18.504293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:18.660580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d44d1e-aa69-4771-a793-19547ba44ad9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:18.747679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:18.789639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:18.790297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:18.790406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:18.790685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:18.792303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:18.883712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:18.885527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40338f87-4c30-4db4-a074-3d12e8d6ff04 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:18.905442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 687/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:21.015368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:21.016220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:21.016845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:21.018395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 674/1361] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:21.024075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717450e-a9b7-483b-895d-c1f7e0e97e5f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:21.024575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717450e-a9b7-483b-895d-c1f7e0e97e5f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:21.024678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717450e-a9b7-483b-895d-c1f7e0e97e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:21.093180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0717450e-a9b7-483b-895d-c1f7e0e97e5f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:21.094384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0717450e-a9b7-483b-895d-c1f7e0e97e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:21.133792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:21.212199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 688/1362] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:21.508102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:21.508102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:21.584198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:21.671189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd880201-d6be-45a2-9db2-f587d2d8d0e8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:21.800326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:21.800856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:21.801291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:21.801569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:21.803184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:21.833907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:21.913082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:21.914899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3459-e794-44ed-92c1-f33e4a6d79cb service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:21.934129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 675/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:24.169055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f84a0-6da5-434b-a219-26a17eab5fa8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:24.170149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f84a0-6da5-434b-a219-26a17eab5fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:24.170149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f84a0-6da5-434b-a219-26a17eab5fa8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:24.171739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 689/1364] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:24.176944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded63d9-5eee-4b7b-a1ad-fc793786277e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:24.177384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded63d9-5eee-4b7b-a1ad-fc793786277e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:24.177489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded63d9-5eee-4b7b-a1ad-fc793786277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:24.245125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7ded63d9-5eee-4b7b-a1ad-fc793786277e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:24.246330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7ded63d9-5eee-4b7b-a1ad-fc793786277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:24.343470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:24.351102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 676/1365] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:24.636516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:24.637011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:24.637438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:24.638929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 690/1366] 10.222.0.73 () {54 vars in 962 bytes} [Thu Aug 18 16:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:24.644340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f701-97bd-4743-a6db-d592c68dfd70 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:24.644625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f701-97bd-4743-a6db-d592c68dfd70 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:24.644900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f701-97bd-4743-a6db-d592c68dfd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:24.737686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3400f701-97bd-4743-a6db-d592c68dfd70 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:24.739031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3400f701-97bd-4743-a6db-d592c68dfd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:24.879247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 677/1367] 10.222.0.73 () {58 vars in 1059 bytes} [Thu Aug 18 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:24.888081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:24.889722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:25.052678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51636b79-1b9d-44bd-8b88-b5fd274069b8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:25.074256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:25.171320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:25.172093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:25.172390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:25.172661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:25.174236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:25.265146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:25.266746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4833d4-c58b-4253-876e-4e619e8eae00 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:25.285769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 691/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:25.877952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817d44-54f7-45c3-aee9-d5e3830b005c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:25.878982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817d44-54f7-45c3-aee9-d5e3830b005c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:25.879625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817d44-54f7-45c3-aee9-d5e3830b005c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:25.881067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 678/1369] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:25.886446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f231-31d9-4759-a6be-7c115550bab7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:25.886726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f231-31d9-4759-a6be-7c115550bab7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:25.886996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7f231-31d9-4759-a6be-7c115550bab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:25.920794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:25.957357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ebc7f231-31d9-4759-a6be-7c115550bab7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:25.958656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ebc7f231-31d9-4759-a6be-7c115550bab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:26.061871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 692/1370] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:26.656601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:26.656601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:26.656601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:26.658812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 679/1371] 10.222.0.73 () {54 vars in 964 bytes} [Thu Aug 18 16:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:26.662176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1f25-312f-4bf0-9f92-487fd1e66f79 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:26.662687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1f25-312f-4bf0-9f92-487fd1e66f79 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:26.662852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af1f25-312f-4bf0-9f92-487fd1e66f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:26.744437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c2af1f25-312f-4bf0-9f92-487fd1e66f79 None None] MFA Rules not processed for user `4fd9346df56842ec95720f6d4e859559`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:26.745647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2af1f25-312f-4bf0-9f92-487fd1e66f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:26.794782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:26.826292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 693/1372] 10.222.0.73 () {58 vars in 1061 bytes} [Thu Aug 18 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:26.834128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:26.835687 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:26.889748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:26.947219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f04864-7e4c-47a3-b6f1-1b8182f5f95f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:27.028530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:27.029845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:27.030221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:27.030590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:27.032322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:27.152198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:27.166861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:27.168470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc0ed-7c31-429e-b5c6-e6d7a43207a2 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:27.190153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 680/1373] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:27.256428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:27.256762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:27.256974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:27.259093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 694/1374] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:27.263741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20a48-8ee3-4aa1-b60f-aa8075d94a34 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:27.263952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20a48-8ee3-4aa1-b60f-aa8075d94a34 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:27.264360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20a48-8ee3-4aa1-b60f-aa8075d94a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:27.333217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4bd20a48-8ee3-4aa1-b60f-aa8075d94a34 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:27.334608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4bd20a48-8ee3-4aa1-b60f-aa8075d94a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:27.453048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 681/1375] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:27.740382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:27.741882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:27.890570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4bfc1-939e-45fa-87a4-3f527da2a64d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:27.941442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:28.002276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:28.002787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:28.003063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:28.003329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:28.004945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:28.091383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:28.092997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26ec3-dccc-4e75-8560-2e780c3cbc36 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:28.110911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 695/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:30.044574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:30.045109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:30.045109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:30.046614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 682/1377] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:30.051725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad61d-316e-4496-a939-d73fe2262950 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:30.052285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad61d-316e-4496-a939-d73fe2262950 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:30.052406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad61d-316e-4496-a939-d73fe2262950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:30.118058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cccad61d-316e-4496-a939-d73fe2262950 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:30.119265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cccad61d-316e-4496-a939-d73fe2262950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:30.128905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:30.242162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 696/1378] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:30.533755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:30.535240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:30.608680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:30.736827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a9ca-8280-44d1-8439-8800fc026735 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:30.870422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:30.871032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:30.871316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:30.871592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:30.873226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:30.892790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:30.972771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:30.975262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f0f65-e382-4eb6-9907-886d94e8835d service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:30.994739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 683/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:32.935003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:32.936333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:32.936333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:32.937596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 697/1380] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:32.942527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303473a-4be6-4ca2-bfa2-c998f5545973 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:32.942915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303473a-4be6-4ca2-bfa2-c998f5545973 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:32.943098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303473a-4be6-4ca2-bfa2-c998f5545973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:33.012245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1303473a-4be6-4ca2-bfa2-c998f5545973 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:33.013601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1303473a-4be6-4ca2-bfa2-c998f5545973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:33.110430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:33.118367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 684/1381] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:33.411016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:33.412561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:33.566468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:33.578635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b6eae-1dc7-4be8-bbb2-8bfb70ffba03 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:33.738015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:33.738766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:33.739148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:33.739524 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:33.741299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:33.852196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:33.854275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c904-3218-4c90-9d05-4f7fc80e40b1 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:33.865384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:33.875947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 698/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:36.135912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:36.136492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:36.136659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:36.139172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 685/1383] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:36.146246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70c12-67b3-471d-a9a8-e8b2044b9121 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:36.146824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70c12-67b3-471d-a9a8-e8b2044b9121 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:36.146994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70c12-67b3-471d-a9a8-e8b2044b9121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:36.230576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0c70c12-67b3-471d-a9a8-e8b2044b9121 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:36.232356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0c70c12-67b3-471d-a9a8-e8b2044b9121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:36.333437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 699/1384] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:36.699645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:36.701709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:36.849108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7243-2028-4aa6-b3fd-052537d56cdc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:36.922160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:36.969076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:36.969599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:36.969873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:36.970136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:36.971711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:37.066059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:37.068228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c55856-7b16-4c6c-9a17-e1d1ec1a0c57 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:37.091910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 686/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:39.524346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:39.525009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:39.525009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:39.526264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 700/1386] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:39.532410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ae38-a1f9-4651-b7a5-7f0da7421694 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:39.532900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ae38-a1f9-4651-b7a5-7f0da7421694 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:39.533096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0ae38-a1f9-4651-b7a5-7f0da7421694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:39.600537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-efa0ae38-a1f9-4651-b7a5-7f0da7421694 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:39.601737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-efa0ae38-a1f9-4651-b7a5-7f0da7421694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:39.634031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:39.699805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 687/1387] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:40.002452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:40.004128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:40.080242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:40.155143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede099-7802-44fc-9a1d-bca839dadfca None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:40.268003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:40.268562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:40.268836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:40.269106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:40.270708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:40.308476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:40.360312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:40.361925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a728fd-193e-487a-82fc-76472f5fca18 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:40.379794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 701/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:42.209084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8464-54bd-4740-b525-1c20bfe815e6 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.209661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8464-54bd-4740-b525-1c20bfe815e6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.209661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8464-54bd-4740-b525-1c20bfe815e6 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.211185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 688/1389] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:42.216880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eecab-be20-433d-93a0-5a021472190b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.217301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eecab-be20-433d-93a0-5a021472190b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.217570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55eecab-be20-433d-93a0-5a021472190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.287350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e55eecab-be20-433d-93a0-5a021472190b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:42.288750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e55eecab-be20-433d-93a0-5a021472190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:42.292526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2edc-163c-42a5-a5a4-147500e8d90f None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.292880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2edc-163c-42a5-a5a4-147500e8d90f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.293162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f2edc-163c-42a5-a5a4-147500e8d90f None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.295068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 689/1390] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:33:42.300112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fecca-485d-422a-a5a3-7e31339087b1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.300403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fecca-485d-422a-a5a3-7e31339087b1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.300700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fecca-485d-422a-a5a3-7e31339087b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.366280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9c7fecca-485d-422a-a5a3-7e31339087b1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:42.367507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9c7fecca-485d-422a-a5a3-7e31339087b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:42.392095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 702/1391] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:42.462439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 690/1392] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:33:42.684862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.685152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.685430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.686755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 703/1393] 10.222.0.73 () {54 vars in 967 bytes} [Thu Aug 18 16:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:42.691903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.692248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.692527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.708422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:42.752865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:42.754353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:42.768781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:42.772690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] MFA Rules not processed for user `8ee82cc4136a4b23aeaf4e115fe7bd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:42.773905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:42.849486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 691/1394] 10.222.0.73 () {58 vars in 1064 bytes} [Thu Aug 18 16:33:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:42.857163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:42.864636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de9317-3594-4a13-9a77-bf23201d5688 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:42.907517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91d521-050b-4140-9fdb-569df039e1e4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:42.943198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:42.943804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:42.944112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:42.944390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:42.945987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:42.976696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:42.996418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:43.024778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:43.025383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:43.025657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:43.025922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:43.027489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:43.055286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:43.056767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194e8d4-c22f-4d6a-b508-5cabe1786f0e service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:43.076629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 692/1395] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:33:43.117326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:43.118934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7cfa3-3126-4d93-a656-67dcabed0cb9 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:43.137096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 704/1396] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:33:43.820993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdfab-2e60-4692-b926-e45b9f0f49b5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:43.821478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdfab-2e60-4692-b926-e45b9f0f49b5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:43.821663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdfab-2e60-4692-b926-e45b9f0f49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:43.887121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-589bdfab-2e60-4692-b926-e45b9f0f49b5 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:43.888860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-589bdfab-2e60-4692-b926-e45b9f0f49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:43.967372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:43.973521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 693/1397] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:44.019680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:44.020195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:44.020337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:44.021602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 705/1398] 10.222.0.73 () {54 vars in 943 bytes} [Thu Aug 18 16:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:44.028810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517cc07-53b3-4c8f-a53a-cf3988791bc8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:44.029183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517cc07-53b3-4c8f-a53a-cf3988791bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:44.029488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517cc07-53b3-4c8f-a53a-cf3988791bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:44.104136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7517cc07-53b3-4c8f-a53a-cf3988791bc8 None None] MFA Rules not processed for user `c47af3f28f044f68a90e6a78ee3102a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:44.105497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7517cc07-53b3-4c8f-a53a-cf3988791bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:44.215211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 694/1399] 10.222.0.73 () {58 vars in 1040 bytes} [Thu Aug 18 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:44.225057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:44.226555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:44.323003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:44.362470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f56bde-77a7-4504-8620-465e1d2afa91 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:44.463638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:44.464335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:44.464611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:44.464881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:44.466517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:44.548266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:44.549863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165096af-1962-4277-a18c-def6dc4d86e0 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:44.553265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:44.562012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 706/1400] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:33:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:33:45.117856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:45.118513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:45.118513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:45.123789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 695/1401] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:45.125195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3f02-f630-4573-895d-8d1ae7e84b8a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:45.125725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3f02-f630-4573-895d-8d1ae7e84b8a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:45.125725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3f02-f630-4573-895d-8d1ae7e84b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:45.195710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9eae3f02-f630-4573-895d-8d1ae7e84b8a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:45.197243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9eae3f02-f630-4573-895d-8d1ae7e84b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:45.300990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 707/1402] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:45.606080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:45.607594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:45.673600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:45.776501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e86fd-9b04-4087-8eb8-e03a395e189d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:45.903856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:45.904799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:45.905078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:45.905351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:45.907048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:45.926108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:46.005949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:46.007968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0936cb-35cf-4d30-9df1-119058663519 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:46.028976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 696/1403] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:47.981422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:47.981953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:47.981953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:47.983354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 708/1404] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:47.988421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc528-0548-468c-b421-e503111dc0ef None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:47.988837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc528-0548-468c-b421-e503111dc0ef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:47.989019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fc528-0548-468c-b421-e503111dc0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:48.065591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2b6fc528-0548-468c-b421-e503111dc0ef None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:48.066924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2b6fc528-0548-468c-b421-e503111dc0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:48.196936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:48.216413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 697/1405] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:48.547443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:48.549769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:48.651104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:48.727273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968165d-b8d0-4c49-9da3-86f0d43fbfe3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:48.852665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:48.853688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:48.853968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:48.854239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:48.856427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:48.900669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:48.958083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:48.959727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b23674-2a6a-4f16-a094-f0f6c73399b6 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:48.981638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 709/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:33:50.929443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:50.930078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:50.930078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:50.935926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 698/1407] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:33:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:33:50.937613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558e9f-54d5-42a5-99b5-e04980a6587c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:50.938053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558e9f-54d5-42a5-99b5-e04980a6587c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:50.938153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558e9f-54d5-42a5-99b5-e04980a6587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:51.010168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e3558e9f-54d5-42a5-99b5-e04980a6587c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:33:51.011293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e3558e9f-54d5-42a5-99b5-e04980a6587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:51.116473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 710/1408] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:33:51.401853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:33:51.404041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:51.564909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b8de9-bbbd-46eb-89fb-a454df8db9a8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:33:51.639659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:33:51.693118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:33:51.693737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:33:51.694039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:33:51.694308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:33:51.696020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:33:51.790645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:33:51.792293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a97a3-4515-4a49-bfd8-4cc258d28d0f service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:33:51.817239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 699/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:34:01.114120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:01.813688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=65 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:06.610529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306a64f-72bc-4990-b4ca-0c833880bc3b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:06.611087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306a64f-72bc-4990-b4ca-0c833880bc3b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:06.611087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306a64f-72bc-4990-b4ca-0c833880bc3b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:06.612464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 711/1410] 10.222.0.73 () {54 vars in 918 bytes} [Thu Aug 18 16:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:06.617506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd46de4-4e4f-451c-ba29-c18ba7f24e90 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:06.617948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd46de4-4e4f-451c-ba29-c18ba7f24e90 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:06.618055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd46de4-4e4f-451c-ba29-c18ba7f24e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:06.692244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9cd46de4-4e4f-451c-ba29-c18ba7f24e90 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:06.693370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9cd46de4-4e4f-451c-ba29-c18ba7f24e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:06.797643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 700/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 18 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:06.811853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452207-d7df-40dd-a803-3f82f30e38a0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:06.812199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452207-d7df-40dd-a803-3f82f30e38a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:06.812474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452207-d7df-40dd-a803-3f82f30e38a0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:06.813813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 712/1412] 10.222.0.73 () {54 vars in 918 bytes} [Thu Aug 18 16:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:06.818383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563591-5160-4e5e-b080-0e6ed3564e54 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:06.818665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563591-5160-4e5e-b080-0e6ed3564e54 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:06.818935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563591-5160-4e5e-b080-0e6ed3564e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:06.890441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:06.892962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9c563591-5160-4e5e-b080-0e6ed3564e54 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:06.894703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9c563591-5160-4e5e-b080-0e6ed3564e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:07.005795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 701/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 18 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:09.350690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:09.351142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:09.351253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:09.352604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:09.358292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0a17-84d3-4875-9a28-92339fea0332 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:09.358717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0a17-84d3-4875-9a28-92339fea0332 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:09.358835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0a17-84d3-4875-9a28-92339fea0332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:09.422610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7d0f0a17-84d3-4875-9a28-92339fea0332 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:09.423779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7d0f0a17-84d3-4875-9a28-92339fea0332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:09.477269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:09.519821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:09.809940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:09.811512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:09.955922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fdaa8-a497-4632-809f-04b0a158c08e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:10.027483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:10.067260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:10.067860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:10.068172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:10.068447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:10.070032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:10.158701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:10.160346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d713f10-3dc5-4ee5-a5e9-4424bb7a7991 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:10.177971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 714/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:11.052505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:11.053038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:11.053038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:11.054369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:11.059983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6662fb-af39-487d-8628-33adc570195d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:11.060413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6662fb-af39-487d-8628-33adc570195d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:11.060560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6662fb-af39-487d-8628-33adc570195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:11.134923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bf6662fb-af39-487d-8628-33adc570195d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:11.136253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bf6662fb-af39-487d-8628-33adc570195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:11.161837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:11.230717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:11.379380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:11.381108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:11.529122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998422b8-65a3-4f22-9b17-d6a2903ef9e9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:11.568800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:11.759080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:11.759673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:11.760735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:11.761027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:11.762626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:11.850209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:11.851787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4207218-4e58-44c6-8ca9-e6fab4e57b18 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:11.869281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 704/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:12.769153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:12.769621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:12.769741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:12.771337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:12.776824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827173b-620d-4dac-9973-e11b643eb305 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:12.777277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827173b-620d-4dac-9973-e11b643eb305 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:12.777383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827173b-620d-4dac-9973-e11b643eb305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:12.830137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:12.851583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3827173b-620d-4dac-9973-e11b643eb305 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:12.852832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3827173b-620d-4dac-9973-e11b643eb305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:12.948631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:34:13.100987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:13.102422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:13.243843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45531e9e-f9ed-42d0-b068-c0e4c6630e70 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:13.255493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:13.352936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:13.353494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:13.353772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:13.354040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:13.355601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:13.441822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:13.443440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899643-99b0-4d45-8535-25c9f555011d service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:13.461572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 717/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:14.322695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:14.323268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:14.323268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:14.324603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:14.329535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25edd37-6457-4fac-b54e-3bdf5135cf76 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:14.329945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25edd37-6457-4fac-b54e-3bdf5135cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:14.330116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25edd37-6457-4fac-b54e-3bdf5135cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:14.349909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:14.406168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b25edd37-6457-4fac-b54e-3bdf5135cf76 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:14.407362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b25edd37-6457-4fac-b54e-3bdf5135cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:14.500971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:14.653504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:14.655002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:14.764707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:14.799809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ef6a-7826-4958-bd1e-ae95c5e33f27 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:14.910128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:14.910654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:14.910930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:14.911205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:14.912867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:14.986448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:15.000377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:15.001961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598c145-d38a-4173-aead-4b4d21b565c7 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:15.020238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 707/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:15.867913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:15.868496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:15.868496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:15.869866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:15.874935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9193-03f6-4314-ae22-545fc7e62844 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:15.875366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9193-03f6-4314-ae22-545fc7e62844 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:15.875463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e9193-03f6-4314-ae22-545fc7e62844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:15.948814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e25e9193-03f6-4314-ae22-545fc7e62844 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:15.949996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e25e9193-03f6-4314-ae22-545fc7e62844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:16.042391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:16.194063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:16.195605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:16.279931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:16.339482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d8a42-6825-4c57-9787-741b80e3041c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:16.446399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:16.446859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:16.447627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:16.447897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:16.449487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:16.496012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:16.537301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:16.538892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3be4d-df5d-46a7-8597-b27b6aaf5fdd service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:16.556959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 720/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:17.346074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:17.346653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:17.346653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:17.348005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:17.352737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f772452-e9fc-4a50-b322-b06aa7bff2c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:17.353158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f772452-e9fc-4a50-b322-b06aa7bff2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:17.353436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f772452-e9fc-4a50-b322-b06aa7bff2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:17.428419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9f772452-e9fc-4a50-b322-b06aa7bff2c3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:17.429619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f772452-e9fc-4a50-b322-b06aa7bff2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:17.522205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:17.671868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:17.673406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:17.721873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:17.817343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c51e-54e9-40b4-8673-462cbb434e8b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:17.927479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:17.928003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:17.928308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:17.928578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:17.930157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:17.936986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:18.017779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:18.019355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141b61-a1be-4451-8ee5-ba7226bea1eb service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:18.036589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 710/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:18.833993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:18.834536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:18.834536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:18.835885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:18.841355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16eaaa-d032-4815-8faf-a4622c8f36f7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:18.841787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16eaaa-d032-4815-8faf-a4622c8f36f7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:18.841886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16eaaa-d032-4815-8faf-a4622c8f36f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:18.920551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1d16eaaa-d032-4815-8faf-a4622c8f36f7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:18.921922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1d16eaaa-d032-4815-8faf-a4622c8f36f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:18.988852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:19.017598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:19.166889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:19.168419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:19.185338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:19.308145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfef4df-2b7d-4e08-8558-2b3e410fe5ab None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:19.392381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:19.418130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:19.418728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:19.419004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:19.419273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:19.420899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:19.507253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:19.508872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13334-4254-4a51-beea-629eaeea8304 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:19.527421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 723/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:20.327553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:20.328188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:20.328188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:20.329490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:20.334365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16b34-ade1-4b8a-abea-01892afc6336 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:20.334756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16b34-ade1-4b8a-abea-01892afc6336 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:20.334912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16b34-ade1-4b8a-abea-01892afc6336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:20.409283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6bd16b34-ade1-4b8a-abea-01892afc6336 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:20.410477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6bd16b34-ade1-4b8a-abea-01892afc6336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:20.450418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:20.503577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:20.654231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:20.655769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:20.797300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc497a-52bc-4fc6-aca0-ba3cdf4870e4 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:20.850036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:20.907336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:20.907862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:20.908165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:20.908434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:20.909986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:20.995785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:20.997432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07582b88-b69c-41b0-90a7-ba0a79de207e service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:21.015616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 713/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:21.827450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:21.827912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:21.828019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:21.829349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:21.834217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a84a0-5fc3-45ad-80b6-3d2a32f748a2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:21.834698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a84a0-5fc3-45ad-80b6-3d2a32f748a2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:21.834819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a84a0-5fc3-45ad-80b6-3d2a32f748a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:21.909533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9e5a84a0-5fc3-45ad-80b6-3d2a32f748a2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:21.910788 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9e5a84a0-5fc3-45ad-80b6-3d2a32f748a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:21.912809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:22.005669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:22.155565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:22.157185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:22.298792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f4d2-e350-44cd-8da2-e734228c906c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:22.325035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:22.409453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:22.410062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:22.410344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:22.410617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:22.412229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:22.501848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:22.503431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91984137-ee4c-4f60-96ff-66127e4317a0 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:22.521639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 726/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:24.310029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:24.310611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:24.310611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:24.311937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:24.317204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9041-96b7-4c6d-a575-09a0192ac2b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:24.317644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9041-96b7-4c6d-a575-09a0192ac2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:24.317788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e9041-96b7-4c6d-a575-09a0192ac2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:24.359753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:24.385049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-280e9041-96b7-4c6d-a575-09a0192ac2b9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:24.386185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-280e9041-96b7-4c6d-a575-09a0192ac2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:24.479614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:24.770078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:24.771857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:24.875489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99daed-2108-45bf-91a0-562e0fe93629 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:24.906419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:24.945649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:24.946228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:24.946527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:24.946794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:24.948377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:25.052267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:25.053615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e391-ba49-408f-8e30-5a29694afbdd service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:25.071315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 716/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:27.147746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:27.148345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:27.148345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:27.150317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:27.155624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f23a-31a8-4f5e-a502-0a9198d4f24e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:27.156033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f23a-31a8-4f5e-a502-0a9198d4f24e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:27.156198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2f23a-31a8-4f5e-a502-0a9198d4f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:27.219799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1ab2f23a-31a8-4f5e-a502-0a9198d4f24e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:27.221010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1ab2f23a-31a8-4f5e-a502-0a9198d4f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:27.233370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:27.315361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:27.597067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:27.598613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:27.700903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9a64-cdef-40e9-b8d9-ec50fe3216cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:27.713197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:27.775151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:27.775761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:27.776044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:27.776347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:27.777929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:27.883678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:27.885637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b8e45-643b-46c0-8150-cfbfd3623f04 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:27.903368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 729/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:30.094343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:30.094856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:30.094856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:30.096163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:30.101522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe76c2-0c20-40a7-b608-e217e078bbfa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:30.101971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe76c2-0c20-40a7-b608-e217e078bbfa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:30.102105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe76c2-0c20-40a7-b608-e217e078bbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:30.151094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:30.169517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cfbe76c2-0c20-40a7-b608-e217e078bbfa None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:30.170717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cfbe76c2-0c20-40a7-b608-e217e078bbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:30.264204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:30.546770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:30.548316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:30.647951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7ce21-d8fc-4522-b85f-5f1a79bd4b6e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:30.687696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:30.721817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:30.722418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:30.722696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:30.722968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:30.724565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:30.830639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:30.832087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90df46-21b1-4661-8a3e-cb381cee1740 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:30.849510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 719/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:32.852904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:32.853474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:32.853474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:32.854771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:32.860136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c853ce-53c1-4462-9d73-f69bdcd1b56e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:32.860586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c853ce-53c1-4462-9d73-f69bdcd1b56e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:32.860693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c853ce-53c1-4462-9d73-f69bdcd1b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:32.925779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-70c853ce-53c1-4462-9d73-f69bdcd1b56e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:32.926989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-70c853ce-53c1-4462-9d73-f69bdcd1b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:32.947670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:33.022869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:33.306523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:33.308043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:33.408819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b3398-ebff-4908-868e-e168e8af5ffd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:33.427924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:33.480978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:33.481607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:33.481886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:33.482156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:33.483738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:33.589842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:33.591188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267807d4-911b-46ec-b755-cec75fce2736 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:33.608518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 732/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:35.561743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:35.562304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:35.562304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:35.563552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:35.568763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23e90-cba1-4c4c-af5d-14e0114dfaf7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:35.569211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23e90-cba1-4c4c-af5d-14e0114dfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:35.569362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23e90-cba1-4c4c-af5d-14e0114dfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:35.632644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:35.635862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7ba23e90-cba1-4c4c-af5d-14e0114dfaf7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:35.637747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7ba23e90-cba1-4c4c-af5d-14e0114dfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:35.733656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:36.015597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:36.017131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:36.125695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed301-47cf-492e-a988-70cbcf7b1891 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:36.173683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:36.199243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:36.199845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:36.200150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:36.200420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:36.201995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:36.309001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:36.310351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0bb5-ae44-4725-9fcd-b75f2442c0d1 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:36.328680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 722/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:38.371844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:38.372415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:38.372415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:38.373759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:38.379143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70114ef-5bc4-4a3c-8963-d2e308e07c17 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:38.379581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70114ef-5bc4-4a3c-8963-d2e308e07c17 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:38.379699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70114ef-5bc4-4a3c-8963-d2e308e07c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:38.445878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c70114ef-5bc4-4a3c-8963-d2e308e07c17 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:38.447127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c70114ef-5bc4-4a3c-8963-d2e308e07c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:38.475880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:38.542894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:38.830111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:38.831640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:38.932865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8c96-a8f9-4135-89b8-d1217bdf0284 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:38.960375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:39.005257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:39.005861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:39.006139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:39.006407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:39.008670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:39.112916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:39.114343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba38b1-f6a8-4a2c-b899-66fd80ed1bf7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:39.132464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 735/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:41.060846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:41.061411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:41.061411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:41.062658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:41.068007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b71d-0ac1-4315-a203-e11bdb574c41 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:41.068474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b71d-0ac1-4315-a203-e11bdb574c41 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:41.068580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6b71d-0ac1-4315-a203-e11bdb574c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:41.133412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f6f6b71d-0ac1-4315-a203-e11bdb574c41 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:41.134614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f6f6b71d-0ac1-4315-a203-e11bdb574c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:41.142702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:41.229480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:41.506522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:41.508117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:41.609696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5593-0e4d-4a3d-b890-44d517d60bc9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:41.663933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:41.682182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:41.682785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:41.683061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:41.683330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:41.684941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:41.793153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:41.794512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da132c-542c-4ebe-a369-eeb088c4223a service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:41.813485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 725/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:43.736995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:43.737488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:43.737587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:43.738861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:43.744110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88089f-9318-4235-8b66-05346daf083d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:43.744529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88089f-9318-4235-8b66-05346daf083d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:43.744680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88089f-9318-4235-8b66-05346daf083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:43.809780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5a88089f-9318-4235-8b66-05346daf083d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:43.810960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5a88089f-9318-4235-8b66-05346daf083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:43.847706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:43.906303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:44.213533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:44.215122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:44.316792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffc599-8c1f-4773-8654-f952b2a2b82c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:44.354554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:44.390108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:44.390709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:44.390988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:44.391258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:44.392871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:44.500222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:44.501578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eda05-daf0-4601-8ee5-ab1bb50932bb service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:44.520204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 738/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:46.413474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:46.414054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:46.414054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:46.415387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:46.420514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1d9b-6113-496a-ab2a-00c8cb2f97ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:46.420968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1d9b-6113-496a-ab2a-00c8cb2f97ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:46.421080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee1d9b-6113-496a-ab2a-00c8cb2f97ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:46.487634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b9ee1d9b-6113-496a-ab2a-00c8cb2f97ac None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:46.488868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b9ee1d9b-6113-496a-ab2a-00c8cb2f97ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:46.507142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:46.584144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:46.867632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:46.869304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:46.969042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294761e-b06f-40a0-bf98-cc0a032b1251 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:47.033175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:47.041048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:47.041646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:47.041921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:47.042188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:47.043747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:47.149435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:47.150864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a9fc-8da9-4dfd-9ce0-35c0fb85a567 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:47.169637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 728/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:49.056645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:49.057181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:49.057181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:49.058451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:34:49.063649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfde3-3dca-4da0-83b4-3eb4bde7716b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:49.064099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfde3-3dca-4da0-83b4-3eb4bde7716b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:49.064245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfde3-3dca-4da0-83b4-3eb4bde7716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:49.128399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-29bdfde3-3dca-4da0-83b4-3eb4bde7716b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:34:49.129863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-29bdfde3-3dca-4da0-83b4-3eb4bde7716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:49.177969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:49.225300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:34:49.503025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:34:49.504862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:49.605051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457a090-11a1-4387-9390-b1220ead4806 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:34:49.654248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:49.679748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:34:49.680376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:34:49.680656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:34:49.680926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:34:49.682548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:34:49.798312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:34:49.799693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fd54f-8824-4930-b9fb-fc5de8eef1b4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:34:49.817796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 741/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:34:59.223501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=22 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:34:59.815328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=66 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:09.113386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b363-d592-487a-be0b-7d0833ced97c None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:09.113918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b363-d592-487a-be0b-7d0833ced97c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:09.113918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b363-d592-487a-be0b-7d0833ced97c None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:09.115198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 730/1471] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:09.120315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eacd8-4c62-4326-90ae-139f662cc3d9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:09.120717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eacd8-4c62-4326-90ae-139f662cc3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:09.120859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eacd8-4c62-4326-90ae-139f662cc3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:09.185699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5b9eacd8-4c62-4326-90ae-139f662cc3d9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:09.186898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5b9eacd8-4c62-4326-90ae-139f662cc3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:09.279433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 742/1472] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:09.572515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:09.572806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:09.573084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:09.574444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 731/1473] 10.222.0.73 () {54 vars in 967 bytes} [Thu Aug 18 16:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:09.579117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f333-6d7c-4759-8dae-571e44d0c23e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:09.579412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f333-6d7c-4759-8dae-571e44d0c23e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:09.579688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916f333-6d7c-4759-8dae-571e44d0c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:09.653916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9916f333-6d7c-4759-8dae-571e44d0c23e None None] MFA Rules not processed for user `8ee82cc4136a4b23aeaf4e115fe7bd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:09.655128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9916f333-6d7c-4759-8dae-571e44d0c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:09.675543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:09.730984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 743/1474] 10.222.0.73 () {58 vars in 1064 bytes} [Thu Aug 18 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:09.738309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:09.739834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:09.840859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d88e-5624-476d-8ab0-cc5e8a52f159 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:09.915845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:09.916479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:09.916758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:09.917028 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:09.918602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:09.970935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:10.025850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:10.027288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdf7a8-2425-4888-baf3-463ef7bacf4c service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:10.045345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 732/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:12.011187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:12.011720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:12.011720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:12.013015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 744/1476] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:12.018158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f800-2deb-471e-abd5-15017e03e1c9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:12.018600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f800-2deb-471e-abd5-15017e03e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:12.018708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6f800-2deb-471e-abd5-15017e03e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:12.083710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2cf6f800-2deb-471e-abd5-15017e03e1c9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:12.085439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2cf6f800-2deb-471e-abd5-15017e03e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:12.179718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 733/1477] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:35:12.449104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:12.450634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:12.573923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273ad4a-14f5-4c57-8a51-a96ebf4dffa1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:12.620820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:12.664582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:12.665185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:12.665461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:12.665731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:12.666357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:12.668129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:35:12.668129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:35:12.668129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:35:12.669271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571c709-007f-4bd7-bebb-f8ea11bb45e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:12.688547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 745/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Thu Aug 18 16:35:12 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:35:14.594545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:14.595114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:14.595114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:14.596479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 734/1479] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:14.602185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4414-6a5c-4d62-b94d-fef7b31fa0a0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:14.602622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4414-6a5c-4d62-b94d-fef7b31fa0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:14.602897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4414-6a5c-4d62-b94d-fef7b31fa0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:14.675471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-446e4414-6a5c-4d62-b94d-fef7b31fa0a0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:14.677267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-446e4414-6a5c-4d62-b94d-fef7b31fa0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:14.781159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 746/1480] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:15.071805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:15.073406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:15.083090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:15.217376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec55be-c97f-48d5-ac1b-22fc42dbbd37 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:15.295568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:15.326810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:15.327322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:15.327596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:15.327858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:15.329444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:15.418198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:15.419767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e28d5-72e6-44ad-af2f-1f3b62fa6332 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:15.437272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 735/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:17.502515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:17.503095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:17.503220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:17.504892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 747/1482] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:17.510931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146e50-0824-4b1f-a507-3cde416b6dc9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:17.511336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146e50-0824-4b1f-a507-3cde416b6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:17.511502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146e50-0824-4b1f-a507-3cde416b6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:17.575665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-82146e50-0824-4b1f-a507-3cde416b6dc9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:17.576892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-82146e50-0824-4b1f-a507-3cde416b6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:17.623672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:17.672915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 736/1483] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:17.959641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:17.961331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:17.984625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:18.062763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6923ba-a58a-4d3f-ba1a-b0e20b5f11c1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:18.133757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:18.134360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:18.134643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:18.134915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:18.136535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:18.328114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:18.364333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:18.365774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7173b83-e0ae-43d1-9768-7050ec4ed707 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:18.384367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 748/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:20.337592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:20.338131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:20.338131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:20.339401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 737/1485] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:20.344480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7386fe-4864-47a1-a5eb-da7401d8d8e5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:20.344926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7386fe-4864-47a1-a5eb-da7401d8d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:20.345035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7386fe-4864-47a1-a5eb-da7401d8d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:20.412676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9d7386fe-4864-47a1-a5eb-da7401d8d8e5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:20.413880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d7386fe-4864-47a1-a5eb-da7401d8d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:20.508043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 749/1486] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:20.795994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:20.797521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:20.898724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4aee-355f-46c8-8815-c272116a701e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:20.968632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:20.970413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:20.970946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:20.971447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:20.971926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:20.973752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:21.079145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:21.080522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb792e07-34f0-43de-a575-83e15699b812 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:21.099575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 738/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:23.218251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:23.218778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:23.218778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:23.220127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 750/1488] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:23.225941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17c97-c401-4a32-bb0a-0482824537c5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:23.226387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17c97-c401-4a32-bb0a-0482824537c5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:23.226523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e17c97-c401-4a32-bb0a-0482824537c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:23.290212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d5e17c97-c401-4a32-bb0a-0482824537c5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:23.291408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d5e17c97-c401-4a32-bb0a-0482824537c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:23.341784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:23.385937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 739/1489] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:23.672519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:23.674079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:23.710017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:23.779556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e8587-b8c2-491d-9ba0-41f04c9367dd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:23.850660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:23.851292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:23.851569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:23.851839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:23.853475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:23.930525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:23.965684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:23.967111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc438d9-4c1d-49dd-84e6-309a1c4b50a1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:23.985700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 751/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:26.053341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:26.053873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:26.053873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:26.055206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 740/1491] 10.222.0.73 () {54 vars in 927 bytes} [Thu Aug 18 16:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:35:26.060268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1bff-93bc-4890-8d9a-c0dd75950897 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:26.060674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1bff-93bc-4890-8d9a-c0dd75950897 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:26.060813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1bff-93bc-4890-8d9a-c0dd75950897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:26.123534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-952b1bff-93bc-4890-8d9a-c0dd75950897 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:35:26.124740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-952b1bff-93bc-4890-8d9a-c0dd75950897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:26.217461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 752/1492] 10.222.0.73 () {58 vars in 1024 bytes} [Thu Aug 18 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:35:26.504326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:35:26.505850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:26.606647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb18333-e867-4318-9dd9-0f2d12402220 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:35:26.676900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:35:26.677493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:35:26.677765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:35:26.678029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:35:26.679570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:35:26.688297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:26.786983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:35:26.788455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba41553-d4dc-4024-9b11-8da0847228d6 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:35:26.805803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 741/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:35:36.215709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=82 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:35:36.803548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=50 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:44.576280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:44.576785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:44.576891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:44.650845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:36:44.652042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:44.745235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 753/1494] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:36:44.754021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:44.754501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:44.754501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:44.829097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:36:44.830915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:44.924077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 742/1495] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:36:44.928699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:44.929975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:44.941706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c99a74-8ce1-47fe-8888-6e6b06976fd0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.003021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:45.035960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.036523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.036800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.037070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.037703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:36:45.038004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.039007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.039007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:36:45.039007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:36:45.039885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.051070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 754/1496] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:36:45.059259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:45.068999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b9dd4-2569-4ca6-a284-cba2bba2563c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.129559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:45.163272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.163868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.164178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.164445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.165062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.166836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.166836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:36:45.166836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:36:45.168010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.223393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 743/1497] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:36:45 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:36:45.227565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:45.229084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:45.261777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64f54f-2f65-4f97-9e2f-d15ef56229cf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.350993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.351513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.351787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.352047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.352682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.353680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.353680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:36:45.353680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:36:45.354868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.395758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 755/1498] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:36:45 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:36:45.399833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:45.401346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:45.461531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1583a4-113c-46d9-88e6-f35219af1b15 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.540818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:45.551679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.552308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.552583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.552849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.553477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.554480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.554480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:36:45.554480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:36:45.555348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.567879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 744/1499] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:36:45.571865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:45.573414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:45.585283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33443801-bf46-49c6-8a95-e569ca1dfa8b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.609712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:45.678719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.679317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.679594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.679864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.680536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.681537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.681537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:36:45.681537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:36:45.682412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4d384-33e2-4255-ac39-1df0bf4d68aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.694945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 756/1500] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:36:45.699324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:45.700867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:45.733626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548bddf-82ce-40ef-a962-5083b299eac0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:45.826497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:45.827166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.827435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.827711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] PATH_INFO: `/v3/projects/dad9f61898c04463bfaffaf8a6515bbc/users/87a0447846d6478ca84442e4e5a273a5/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.849197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad9f61898c04463bfaffaf8a6515bbc, user_id=87a0447846d6478ca84442e4e5a273a5, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:45.850227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:45.850227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:36:45.850227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:36:45.852211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f126c-1667-42e8-a910-5c45bb978df3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:45.877471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 745/1501] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:36:45 2022] PUT /identity/v3/projects/dad9f61898c04463bfaffaf8a6515bbc/users/87a0447846d6478ca84442e4e5a273a5/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:36:45.889335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6ce4-2b13-4a6f-88a9-01837fe37d08 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:45.889623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6ce4-2b13-4a6f-88a9-01837fe37d08 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:45.889900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa6ce4-2b13-4a6f-88a9-01837fe37d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:45.945374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eaaa6ce4-2b13-4a6f-88a9-01837fe37d08 None None] MFA Rules not processed for user `87a0447846d6478ca84442e4e5a273a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:36:45.946582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eaaa6ce4-2b13-4a6f-88a9-01837fe37d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:46.021146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 757/1502] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:36:46.034256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.034544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.034815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.036196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 746/1503] 10.222.0.73 () {54 vars in 964 bytes} [Thu Aug 18 16:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:36:46.040870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fd5d-70a3-4446-9703-d22ee6a06d1b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.041160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fd5d-70a3-4446-9703-d22ee6a06d1b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.041439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422fd5d-70a3-4446-9703-d22ee6a06d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.072799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:46.117088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d422fd5d-70a3-4446-9703-d22ee6a06d1b None None] MFA Rules not processed for user `4fd9346df56842ec95720f6d4e859559`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:36:46.118267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d422fd5d-70a3-4446-9703-d22ee6a06d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:46.190939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 758/1504] 10.222.0.73 () {58 vars in 1061 bytes} [Thu Aug 18 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:36:46.198691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:46.200207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:46.250679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:46.303949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff785c6-a8d8-408c-9fb9-c31572b8b474 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:46.374653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:46.375248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.375525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.375794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.377695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:46.478952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:46.480333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:46.483726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:46.498203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 747/1505] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:36:46.543052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5a3f-01dc-4e9e-aca6-025839b35d28 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.543343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5a3f-01dc-4e9e-aca6-025839b35d28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.543629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5a3f-01dc-4e9e-aca6-025839b35d28 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.544944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 759/1506] 10.222.0.73 () {52 vars in 830 bytes} [Thu Aug 18 16:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:36:46.548538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:46.549737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:46.646389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd59c-b969-46e3-ae5d-2d44ffffa21a service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:46.737996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:46.738620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.738897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.739165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] PATH_INFO: `/v3/users/87a0447846d6478ca84442e4e5a273a5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.751316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a0447846d6478ca84442e4e5a273a5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:46.752663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:46.752663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:36:46.752663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:36:46.753867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:46.763361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:46.820395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a0447846d6478ca84442e4e5a273a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:46.820934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a0447846d6478ca84442e4e5a273a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:46.832282 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a0447846d6478ca84442e4e5a273a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:46.846116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a0447846d6478ca84442e4e5a273a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:46.846567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a0447846d6478ca84442e4e5a273a5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:46.873909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 748/1507] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:36:46 2022] DELETE /identity/v3/users/87a0447846d6478ca84442e4e5a273a5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:36:46.878952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:46.879440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:46.879548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:46.934307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:36:46.935506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:47.008787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:47.022417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 760/1508] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:36:47.031833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:47.033129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:47.130165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4184f4-ad5b-46cb-ac57-7b391f1d9ae2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:47.183288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:47.203452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:47.204069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:47.204361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:47.205245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:47.206840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:47.311228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:47.312619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993122c6-f890-479b-a43d-225b4168fb76 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:47.330920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 749/1509] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:36:47.681889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:36:47.683176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:36:47.694383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f07f-cff1-4cb4-a534-16d5d87b6dad None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:36:47.797026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:36:47.797652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:36:47.797927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:36:47.798210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] PATH_INFO: `/v3/projects/dad9f61898c04463bfaffaf8a6515bbc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:36:47.808256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad9f61898c04463bfaffaf8a6515bbc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:36:47.809272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:36:47.809272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:36:47.809272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:36:47.810452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:36:47.866472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad9f61898c04463bfaffaf8a6515bbc', 'request_id': 'req-176b9782-ef15-4861-a4a3-0c68fdcf61e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:47.872314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad9f61898c04463bfaffaf8a6515bbc', 'request_id': 'req-176b9782-ef15-4861-a4a3-0c68fdcf61e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:47.885277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad9f61898c04463bfaffaf8a6515bbc', 'request_id': 'req-176b9782-ef15-4861-a4a3-0c68fdcf61e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:47.912639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] The token cache is being invalidate because project dad9f61898c04463bfaffaf8a6515bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:36:47.912922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:47.913428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-176b9782-ef15-4861-a4a3-0c68fdcf61e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:36:47.914689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 761/1510] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:36:47 2022] DELETE /identity/v3/projects/dad9f61898c04463bfaffaf8a6515bbc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:36:57.328733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=62 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:36:57.910628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:38:23.534730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:23.535300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:23.535300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:23.536620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:23.541436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170cbfc-e914-42fd-adf7-9b378fd570c7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:23.541839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170cbfc-e914-42fd-adf7-9b378fd570c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:23.541983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170cbfc-e914-42fd-adf7-9b378fd570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:23.620278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5170cbfc-e914-42fd-adf7-9b378fd570c7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:23.621477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5170cbfc-e914-42fd-adf7-9b378fd570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:23.724218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:23.879314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:23.881451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:23.996775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c76762-df3f-4070-a64f-ede8871b5726 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:24.002468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:24.003064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:24.003343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:24.003612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:24.011476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:24.013068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b00818-3c78-4ced-ab3c-de37ddd58d44 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:24.022165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 751/1513] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:24.883181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3200e3-6f0f-4727-bc92-21dcd19eeafe None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:24.883725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3200e3-6f0f-4727-bc92-21dcd19eeafe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:24.883725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3200e3-6f0f-4727-bc92-21dcd19eeafe None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:24.885155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:24.890000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5770-edfb-42a7-a19c-f480adba94e5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:24.890427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5770-edfb-42a7-a19c-f480adba94e5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:24.890595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5770-edfb-42a7-a19c-f480adba94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:24.916604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-50dc5770-edfb-42a7-a19c-f480adba94e5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:24.917797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-50dc5770-edfb-42a7-a19c-f480adba94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:24.925616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:25.078182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3200e3-6f0f-4727-bc92-21dcd19eeafe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:25.092208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3200e3-6f0f-4727-bc92-21dcd19eeafe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:25.097633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:25.098234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:25.098513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:25.098784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:25.106850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:25.108456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440625-d0b1-41ac-a7e6-b4b8089898ca service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:25.118244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 764/1516] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:25.475319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604dab3-94d1-4d49-9f20-c98e1d976fef None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:25.475604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604dab3-94d1-4d49-9f20-c98e1d976fef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:25.475878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604dab3-94d1-4d49-9f20-c98e1d976fef None None] PATH_INFO: `/v3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:25.477213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 753/1517] 10.222.0.46 () {54 vars in 925 bytes} [Thu Aug 18 16:38:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:38:25.483188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44b049-c1f2-4678-9b32-0059f6b4f854 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:25.483476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44b049-c1f2-4678-9b32-0059f6b4f854 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:25.483747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44b049-c1f2-4678-9b32-0059f6b4f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:25.542451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad44b049-c1f2-4678-9b32-0059f6b4f854 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:25.543645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad44b049-c1f2-4678-9b32-0059f6b4f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:25.560666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:38:25.615011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 765/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 18 16:38:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:29.418026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd350e-f1a8-4a79-8e0a-82acce480477 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:29.418505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd350e-f1a8-4a79-8e0a-82acce480477 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:29.418505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd350e-f1a8-4a79-8e0a-82acce480477 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:29.419850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 754/1519] 10.222.0.73 () {54 vars in 961 bytes} [Thu Aug 18 16:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:29.424887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eda4-fdac-441d-8a97-9cb0a389563c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:29.425299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eda4-fdac-441d-8a97-9cb0a389563c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:29.425442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32eda4-fdac-441d-8a97-9cb0a389563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:29.444837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7b32eda4-fdac-441d-8a97-9cb0a389563c None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:29.446021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b32eda4-fdac-441d-8a97-9cb0a389563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:29.454936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 766/1520] 10.222.0.73 () {58 vars in 1058 bytes} [Thu Aug 18 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:29.462166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd350e-f1a8-4a79-8e0a-82acce480477 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:29.475371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd350e-f1a8-4a79-8e0a-82acce480477 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:29.480448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:29.481037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:29.481319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:29.481620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:29.489937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:29.491496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87043c13-b079-4690-92d7-530155e5d1cf service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:29.501938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 755/1521] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:36.324148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd64-f2e5-4743-afb3-3b2a692a1cf5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:36.324698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd64-f2e5-4743-afb3-3b2a692a1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:36.324698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42dd64-f2e5-4743-afb3-3b2a692a1cf5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:36.326024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:36.331186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac839-0f14-4c54-a4d0-02e36d346970 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:36.331610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac839-0f14-4c54-a4d0-02e36d346970 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:36.331724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac839-0f14-4c54-a4d0-02e36d346970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:36.351533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-759ac839-0f14-4c54-a4d0-02e36d346970 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:36.352768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-759ac839-0f14-4c54-a4d0-02e36d346970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:36.360565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:36.512496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42dd64-f2e5-4743-afb3-3b2a692a1cf5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:36.527266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42dd64-f2e5-4743-afb3-3b2a692a1cf5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:36.533252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:36.533846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:36.534128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:36.534403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:36.542414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:36.543987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7578fe-f6f4-4c7c-bae9-c1b1f2f4dc57 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:36.553340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 768/1524] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:37.367678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ad9-fd18-46e4-992c-9e1f484c70ef None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:37.368260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ad9-fd18-46e4-992c-9e1f484c70ef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:37.368260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8ad9-fd18-46e4-992c-9e1f484c70ef None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:37.369585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:37.374420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859758ac-1841-414d-be45-e0c815171fcc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:37.375456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859758ac-1841-414d-be45-e0c815171fcc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:37.375583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859758ac-1841-414d-be45-e0c815171fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:37.394476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-859758ac-1841-414d-be45-e0c815171fcc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:37.395647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-859758ac-1841-414d-be45-e0c815171fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:37.403305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:37.553631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8ad9-fd18-46e4-992c-9e1f484c70ef None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:37.567698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf8ad9-fd18-46e4-992c-9e1f484c70ef None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:37.573021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:37.573602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:37.573876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:37.574143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:37.581986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:37.583551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f32dc-474f-4727-9cb8-79cd4e42fd64 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:37.593007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 758/1527] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:41.453715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740290-edd7-4715-9921-3905d5b84384 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:41.454312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740290-edd7-4715-9921-3905d5b84384 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:41.454312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740290-edd7-4715-9921-3905d5b84384 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:41.455596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:41.460746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1b9f1-1076-44ca-b2ed-a7ab78c8ca52 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:41.461204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1b9f1-1076-44ca-b2ed-a7ab78c8ca52 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:41.461311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1b9f1-1076-44ca-b2ed-a7ab78c8ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:41.480669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ecf1b9f1-1076-44ca-b2ed-a7ab78c8ca52 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:41.481863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ecf1b9f1-1076-44ca-b2ed-a7ab78c8ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:41.490262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:41.777450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740290-edd7-4715-9921-3905d5b84384 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:41.779157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66740290-edd7-4715-9921-3905d5b84384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:41.858299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740290-edd7-4715-9921-3905d5b84384 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:41.861985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:41.862584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:41.862864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:41.863135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:41.871848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:41.873306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1abe58-b3c5-48b7-8c56-4bc51842b9c5 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:41.883179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 771/1530] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:43.766321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f2c41-b7d8-4d18-ac61-670820a3ab43 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:43.766787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f2c41-b7d8-4d18-ac61-670820a3ab43 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:43.767048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f2c41-b7d8-4d18-ac61-670820a3ab43 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:43.768544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:43.773686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3e43-1672-4f76-ba86-5dd2649625ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:43.774085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3e43-1672-4f76-ba86-5dd2649625ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:43.774243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb3e43-1672-4f76-ba86-5dd2649625ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:43.793169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1bbb3e43-1672-4f76-ba86-5dd2649625ff None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:43.794364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1bbb3e43-1672-4f76-ba86-5dd2649625ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:43.802633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:44.089032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f2c41-b7d8-4d18-ac61-670820a3ab43 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:44.100412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f2c41-b7d8-4d18-ac61-670820a3ab43 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:44.103907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:44.104545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:44.104824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:44.105094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:44.113783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:44.115210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c4393-d40d-41f6-b1a2-dd1793e94bca service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:44.124373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 761/1533] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:47.598254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:47.598765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:47.598871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:47.600223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:47.605473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c60bb-2402-47d5-ab71-505765183a02 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:47.605931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c60bb-2402-47d5-ab71-505765183a02 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:47.606036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c60bb-2402-47d5-ab71-505765183a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:47.613483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:38:47.625937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8f9c60bb-2402-47d5-ab71-505765183a02 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:47.627390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8f9c60bb-2402-47d5-ab71-505765183a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:47.635097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:38:48.199373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:48.201103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:48.265254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:38:48.278930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bcf93-63db-4819-93b6-51ed51aa1e55 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:48.283126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:48.283724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:48.284001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:48.284301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:48.293025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:48.294436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf16aa3-492f-4b9f-9dba-bfb410470445 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:48.303612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 774/1536] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:38:50.202712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:50.203272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:50.203272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:50.204691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:38:50.209719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86eab-e33f-4f97-aeb7-e77a0c7eaf68 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:50.210164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86eab-e33f-4f97-aeb7-e77a0c7eaf68 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:50.210284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa86eab-e33f-4f97-aeb7-e77a0c7eaf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:50.229941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-baa86eab-e33f-4f97-aeb7-e77a0c7eaf68 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:38:50.231143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-baa86eab-e33f-4f97-aeb7-e77a0c7eaf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:50.239480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:38:50.778349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:38:50.780023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:38:50.792777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce1cbd-0b3e-4c70-9ff7-db4d16a95a70 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:38:50.797051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:38:50.797630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:38:50.797901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:38:50.798166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:38:50.806852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:38:50.808317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bbbf-4b98-46cc-9de0-889a435f02e6 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:38:50.818207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 764/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:39:00.225259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=11 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:39:00.814025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=8 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:16.850519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89394-411d-41cc-9667-09a6284466cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:16.852009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89394-411d-41cc-9667-09a6284466cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:16.852009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89394-411d-41cc-9667-09a6284466cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:16.885139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-74d89394-411d-41cc-9667-09a6284466cb None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:16.886300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-74d89394-411d-41cc-9667-09a6284466cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:16.894982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 776/1540] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:16.904124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6d664-1593-49c3-927a-d5b7ab1ce80b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:16.904716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6d664-1593-49c3-927a-d5b7ab1ce80b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:16.904818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6d664-1593-49c3-927a-d5b7ab1ce80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:16.932561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bac6d664-1593-49c3-927a-d5b7ab1ce80b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:16.933911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bac6d664-1593-49c3-927a-d5b7ab1ce80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:16.946961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 765/1541] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:16.951722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89394-411d-41cc-9667-09a6284466cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:16.963595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89394-411d-41cc-9667-09a6284466cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:16.971478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:16.972365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:16.972954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:16.973443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:16.974320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:16.974832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:16.977011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:16.993183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 777/1542] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:16.997650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0cda-4358-4c4b-8128-6c3016379b8c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:16.997937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0cda-4358-4c4b-8128-6c3016379b8c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:16.998211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0cda-4358-4c4b-8128-6c3016379b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.007674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.039928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9302-4900-4b00-832f-c364c0717d5c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.041568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-819a0cda-4358-4c4b-8128-6c3016379b8c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.042773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-819a0cda-4358-4c4b-8128-6c3016379b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.054659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.055289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.055570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.055845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.058511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.060432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:17.060432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:40:17.060432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:40:17.060819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802723b2-73e6-4e64-9222-5dbfcb4f5c0c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.067588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 766/1543] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.076038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae887-ea16-42e2-9404-ca42765e5c6d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.076346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae887-ea16-42e2-9404-ca42765e5c6d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.076624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dae887-ea16-42e2-9404-ca42765e5c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.120878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-67dae887-ea16-42e2-9404-ca42765e5c6d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.122240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-67dae887-ea16-42e2-9404-ca42765e5c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.142564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 778/1544] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.144342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d455-2d73-4109-90f0-475d08f3d578 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.144852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d455-2d73-4109-90f0-475d08f3d578 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.145327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d455-2d73-4109-90f0-475d08f3d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.145878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 767/1545] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:17.147139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.147424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.147701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.170846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-41a5d455-2d73-4109-90f0-475d08f3d578 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.172579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41a5d455-2d73-4109-90f0-475d08f3d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.186566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.187795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.248238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 779/1546] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.249586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db245-e266-40a4-9426-038876e45b17 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.249961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db245-e266-40a4-9426-038876e45b17 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.250301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036db245-e266-40a4-9426-038876e45b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.256401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 768/1547] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.257270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.268799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f108-73fa-4991-92bd-a745190838d9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.270565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-036db245-e266-40a4-9426-038876e45b17 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.271749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-036db245-e266-40a4-9426-038876e45b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.273432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.274064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.274340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.274606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.275217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.276256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:17.276256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:40:17.276256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:40:17.277445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eb370-ed23-4686-a00c-aa37941caf78 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.279564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 780/1548] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.280340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db245-e266-40a4-9426-038876e45b17 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.290900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036db245-e266-40a4-9426-038876e45b17 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.297193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.297795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.298110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.298427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.299063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.299367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.303613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 769/1549] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/users => generated 301 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.303763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0379b-e378-4036-8e6b-cdc49fa0f092 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.303866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e09c3-f830-42e8-ac4f-c499be5aff27 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.303866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e09c3-f830-42e8-ac4f-c499be5aff27 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.303866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e09c3-f830-42e8-ac4f-c499be5aff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.313800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 781/1550] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.314998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea16e2a-c058-4b65-94b6-303f6f9bd023 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.315282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea16e2a-c058-4b65-94b6-303f6f9bd023 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.315554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea16e2a-c058-4b65-94b6-303f6f9bd023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.326992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-df9e09c3-f830-42e8-ac4f-c499be5aff27 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.328269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-df9e09c3-f830-42e8-ac4f-c499be5aff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.334567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aea16e2a-c058-4b65-94b6-303f6f9bd023 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.335728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aea16e2a-c058-4b65-94b6-303f6f9bd023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.336842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 770/1551] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.338176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9b2f-512d-4f93-bca8-7ef08cebc906 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.338453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9b2f-512d-4f93-bca8-7ef08cebc906 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.338729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9b2f-512d-4f93-bca8-7ef08cebc906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.350580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 782/1552] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.351805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636484-4d89-4dd5-bd27-3ba8c91be90d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.352117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636484-4d89-4dd5-bd27-3ba8c91be90d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.352387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8636484-4d89-4dd5-bd27-3ba8c91be90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.358583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1aab9b2f-512d-4f93-bca8-7ef08cebc906 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.359783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1aab9b2f-512d-4f93-bca8-7ef08cebc906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.367906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 771/1553] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.368978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.369260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.369534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.375866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d8636484-4d89-4dd5-bd27-3ba8c91be90d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.377498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8636484-4d89-4dd5-bd27-3ba8c91be90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.385818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 783/1554] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.387142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.387473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.387693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.388940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.390128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.398715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 772/1555] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.399540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.408556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.409679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a62bf6-15cd-47d4-9bdc-b74e27c1b36b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.409806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.414218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.414784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.415062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.415336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.415998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.417469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 784/1556] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.417596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ee1e6-3cc8-4b73-a673-0a1784424683 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.418199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.430541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 773/1557] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:17.430729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd93e-acbb-4931-bba9-24abe5e12f3f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.430839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3ac4-9180-4653-a911-c26c27645a06 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.430839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3ac4-9180-4653-a911-c26c27645a06 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.430839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c3ac4-9180-4653-a911-c26c27645a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.434815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.435394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.435669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.435937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.436580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.439247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38108ec7-2b72-43e9-9cf2-db92333dfbf4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.448919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b26c3ac4-9180-4653-a911-c26c27645a06 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.450108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b26c3ac4-9180-4653-a911-c26c27645a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.458773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 774/1558] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.459947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625164-1f09-44a6-832b-e0b26838188a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.460259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625164-1f09-44a6-832b-e0b26838188a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.460593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625164-1f09-44a6-832b-e0b26838188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.468160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 785/1559] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.469394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.469732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.470121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.479968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-db625164-1f09-44a6-832b-e0b26838188a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.481181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-db625164-1f09-44a6-832b-e0b26838188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.488308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:17.489455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:17.534616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:17.541562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 775/1560] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.542690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625164-1f09-44a6-832b-e0b26838188a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.551537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625164-1f09-44a6-832b-e0b26838188a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.555316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 786/1561] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:17.556251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.559765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.560388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.560674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.560950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.561620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.561930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.562945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:17.562945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:40:17.562945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:40:17.564356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.565974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804321ce-6d32-4972-b193-09eff1aaa164 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.570515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.571225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.571507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.571778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.572444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.572746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.574323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.582000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 776/1562] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.582000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.588739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c946d3-b369-49ce-a4d8-5465c5c843ba admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.591189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 787/1563] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.592148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.593382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.593964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.594241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.594510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.595171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.595472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.597077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.602837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eed2c0-0306-4c69-9755-487c326fa135 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.605989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:17.608294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.608890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.609169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.609445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.610145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.611469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 777/1564] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.612204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.615425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.624455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae75f8-6503-4c24-b579-ae01ae6fb406 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.629111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 788/1565] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:17.630061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.633659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.634387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.634664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.634938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.635577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.635880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.637593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.640034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d684290-0619-429e-8856-9827ae45ae73 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.645192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.645776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.646058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.646332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.646943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.648930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.649890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 778/1566] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.650671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.662384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd5b9-09b4-4e01-b9d7-1a243ea45068 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.668140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.668740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.669024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.669298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.669936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.670240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.670870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 789/1567] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.671690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.672035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.680917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee595ea-f21b-4e01-b502-a7562ea10ce7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.684777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 779/1568] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.685608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.686024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.690790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.699739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812316d2-afdc-4916-9381-1601fc04627a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.703353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 790/1569] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:17.704223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.704975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.705569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.705855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.706121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.706738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.708661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.715710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efbc03-5522-4d4f-a987-50ee2e9f7bb9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.721808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.722506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.722796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.723065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.723684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.725633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.738272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 780/1570] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.739156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.760187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 791/1571] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.760187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.805064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4aae-976f-483f-8478-1520b4c20978 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.817856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ed9c-23a7-4dc2-bb56-d6351f0cfe14 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.822736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.823388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.823667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.823936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] PATH_INFO: `/v3/projects/1024d10a927a4266bef3ed73b244093a/users/a9156ad514af481ab39827cf9aca2c72/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.838417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1024d10a927a4266bef3ed73b244093a, user_id=a9156ad514af481ab39827cf9aca2c72, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.839440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:17.839440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:40:17.839440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:40:17.841461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.854813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 792/1572] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:17 2022] PUT /identity/v3/projects/1024d10a927a4266bef3ed73b244093a/users/a9156ad514af481ab39827cf9aca2c72/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:17.855525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.862249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.863022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.863360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.863693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.864555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.867478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.895082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 781/1573] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:17.896034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.915510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:17.919783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d017-ad98-460b-9ea3-e6c3435ce7a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.941468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:17.958402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48096-aac7-4b53-a0f2-f9fd1362717a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.963235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.963846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.964149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.964422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.965053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.966709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.977095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 782/1574] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:17.977858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:17.978125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.978794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.979131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.979461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.980201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.982156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:17.989799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2016d5-546f-402c-b849-5f15565204dd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:17.994653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:17.995227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:17.995504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:17.995774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:17.996396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:17.998263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.009669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 793/1575] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.010569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.028126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 783/1576] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:17 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.028991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.076663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d23b6-e8f0-43e8-b17e-0fc7dc33e039 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.096820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1690f-8425-42f0-978b-70b868114787 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.101554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.102161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.102441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.102717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.103363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.105324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.130079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 784/1577] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.130079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.133713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.134322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.134637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.134911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.135522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.137287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac530e6-100e-4fe4-b9ea-18d0bd61ccef admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.137441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd93c-f661-46f7-b3d9-c6d6bfad1b89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.142142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.143049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.143333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.143656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.144306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.146208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.167899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 794/1578] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.167899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.167899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.167899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.170959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 785/1579] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.171653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.182931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17651588-ab39-4ec3-9548-8ca7da2c9605 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.196550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] MFA Rules not processed for user `a9156ad514af481ab39827cf9aca2c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:18.197763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:18.205782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:18.241316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.241919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.242195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.242462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.243097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.245041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.262945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 795/1580] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:18.263781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.271851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 786/1581] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.272789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.273975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a02362-7448-49ca-b270-04bff148fa38 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.278460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.279047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.279323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.279590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.280245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.281831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.283183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741c05-4274-4b9a-9593-9bbc4737475b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.288395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.289003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.289286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.289562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.290171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.291984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 796/1582] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.295227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.295327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.305279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250f3eb-99b7-4f46-93c3-087d6c48213e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.310480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.311067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.311361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.311622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.312257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.314305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.317922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 787/1583] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.317922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.320856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:18.326901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f68218-0b4d-4ad3-b967-dba63b4752b6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.332149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.332745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.333032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.333307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.333944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.335327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 797/1584] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.335616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.339135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.347639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 788/1585] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.348511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.350576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d191-ecfa-4d4e-952e-816197c7538b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.355160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.355753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.356016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.356315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.356917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.357994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566e03-78f2-4837-abad-3baf8edd4d5b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.358791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.363222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.363794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.364090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.364367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.364986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.366535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.376512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 789/1586] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.377628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.384328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 798/1587] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.385525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.388805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceba298-b364-4e92-aec6-a61333afbadc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.393594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.394172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.394451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.394724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.395169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57d2be-bc07-4465-a95c-767a07fe486e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.395334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.397235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.399717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.400332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.400614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.400886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.401550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.403138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.413509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 799/1588] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.417594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.425770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 790/1589] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.426649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.428412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75277ae5-51fc-4f87-9f3b-c855693db3e0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.484256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.485039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.485967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.486250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] PATH_INFO: `/v3/projects/326a79e2aacf42d4bc799069b1b981c1/users/d5cca2e6407147fd99a92e8f0132d08c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.489006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b665ae-73c6-42ac-bb9f-322b622e8930 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.493541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.494140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.494414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.494796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.495432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.497055 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.500347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=326a79e2aacf42d4bc799069b1b981c1, user_id=d5cca2e6407147fd99a92e8f0132d08c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.503442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.507206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 791/1590] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.508051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.517721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78e8e-d4ac-4b14-9972-c46d11f44de9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.518907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 800/1591] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/326a79e2aacf42d4bc799069b1b981c1/users/d5cca2e6407147fd99a92e8f0132d08c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.519705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.561389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:18.578754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.579885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.580207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.580478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.581113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.582723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.586521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e0d1f-0267-4703-b58d-498d640467bd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.591225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.591819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.592188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.592316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 792/1592] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.592756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.593101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.593387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.595610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.602870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c867-3203-4aec-a2a0-0846c2871468 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.605890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 801/1593] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.606686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.607598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.608243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.608535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.608902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.609408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.611039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.619946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a47a-766c-46b8-8a37-deec4dfdfd72 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.624672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 793/1594] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.625816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.629003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.629896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.630347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.630807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.631818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.634035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.636025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f2970-338e-43b5-a535-67ceabe09b76 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.640998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.642263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.642537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.642806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.643425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.644753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 802/1595] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.645025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.648418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.658528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 794/1596] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.658528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.658774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77d3c-d30b-466f-a929-8c164c31f94f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.663079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.663659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.663936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.664238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.664843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.665349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79164b-5992-4266-a5b7-e7892a7c430a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.666746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.669813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.670371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.670643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.670912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.671521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.673129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9ab9d-deb7-4c2d-b6fb-4d22e3d1404b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.683784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 795/1597] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.685299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.685872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.686390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.688124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 803/1598] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/users => generated 307 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:18.689148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.698814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2060d-19c0-4195-86df-4cc0947c9238 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.703359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.703934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.704752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.705091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.705645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.705930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:18.707130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:18.707247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.714810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 796/1599] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:18.718274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.724347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 804/1600] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.725264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.732479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a06608-fc75-45e9-8ce3-784bb553c125 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.736345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583048e-bbec-42cd-9ed6-2295fe2b07cc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.736548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.737206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.737489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.737762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] PATH_INFO: `/v3/projects/043b300990b94547a44cca41f376a62f/users/453b6e46935f44d09271e2720e4c70b4/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.741032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.741690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.741998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.742271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] PATH_INFO: `/v3/projects/a78d45e3e11f48e89fbc946bd4ed2b64/users/2ef6382c2b9e416c95938c18c0c79307/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.746560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:18.754488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043b300990b94547a44cca41f376a62f, user_id=453b6e46935f44d09271e2720e4c70b4, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.757602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78d45e3e11f48e89fbc946bd4ed2b64, user_id=2ef6382c2b9e416c95938c18c0c79307, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.757980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.760572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.772569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 797/1601] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/043b300990b94547a44cca41f376a62f/users/453b6e46935f44d09271e2720e4c70b4/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.773496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.779150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 805/1602] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/a78d45e3e11f48e89fbc946bd4ed2b64/users/2ef6382c2b9e416c95938c18c0c79307/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.779150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.835056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f8d68-9ccb-4541-b287-0d39b23e3a26 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.837780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370089f-1741-41cb-a0fb-001ae927916e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.839701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.840349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.840635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.840909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.841541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.842390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.843045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.843160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.843328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.843601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] PATH_INFO: `/v3/projects/4c8b1d95641d4d3fb9d8f41d48e1a5c0/users/3d7667f4b70e4dfa88c6826ca8d4b02a/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.853458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 798/1603] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:18.854307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.861916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8b1d95641d4d3fb9d8f41d48e1a5c0, user_id=3d7667f4b70e4dfa88c6826ca8d4b02a, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.863981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272f88-1798-473e-b0e0-bcb15fa124ec admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.864672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.868696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.869457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.869850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.870105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] PATH_INFO: `/v3/projects/3d74b7f20bf448f88cacfe8cfb00d7c4/users/229ab54ddaee45dabf1c38d5d049528d/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.879276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 806/1604] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/4c8b1d95641d4d3fb9d8f41d48e1a5c0/users/3d7667f4b70e4dfa88c6826ca8d4b02a/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.880191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.885614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d74b7f20bf448f88cacfe8cfb00d7c4, user_id=229ab54ddaee45dabf1c38d5d049528d, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.888350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.901811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 799/1605] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/3d74b7f20bf448f88cacfe8cfb00d7c4/users/229ab54ddaee45dabf1c38d5d049528d/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.902567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:18.936657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:18.948955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b7601-ef0a-4dd4-8985-4c768187b20a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.963562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec648-a731-40d3-b47d-5ee70307e1bb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:18.968205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:18.968862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:18.969144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:18.969422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] PATH_INFO: `/v3/projects/e84a3a18907a4e5e9b5c131dda4c3c63/users/c19359f992c54313b7b1dfee4553f7eb/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:18.983235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84a3a18907a4e5e9b5c131dda4c3c63, user_id=c19359f992c54313b7b1dfee4553f7eb, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:18.985983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:18.998692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 800/1606] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:18 2022] PUT /identity/v3/projects/e84a3a18907a4e5e9b5c131dda4c3c63/users/c19359f992c54313b7b1dfee4553f7eb/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:18.999561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.009188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.009806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.010092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.010366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.011007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.012621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0accebc-b02f-4196-a7f9-9f2aef127804 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.022828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 807/1607] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:19.023997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70c69-b2c5-471d-98a0-2dfa5d73ead6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.024315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70c69-b2c5-471d-98a0-2dfa5d73ead6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.024594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70c69-b2c5-471d-98a0-2dfa5d73ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.044387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e0b70c69-b2c5-471d-98a0-2dfa5d73ead6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.045510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:19.045635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0b70c69-b2c5-471d-98a0-2dfa5d73ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.056472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b1f-9b64-4856-8442-4717cd7b6015 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.060251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.060859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.061139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.061412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.105176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 808/1608] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.106704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.106989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.107253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.124358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.125140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.125800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e8174-3a4e-4be8-8848-2b45b5e38aed service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.126847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.134471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 809/1609] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.135209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.136612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 801/1610] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.139312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d00-1fba-4921-873c-081f7df34bd0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.139608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d00-1fba-4921-873c-081f7df34bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.140104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46d00-1fba-4921-873c-081f7df34bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.145625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d823fe-1051-4e16-91c2-b96cfdb08f1e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.151224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.152264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.152712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.153144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] PATH_INFO: `/v3/projects/a7feae7e22154681b96d53317ea1b19f/users/5385c077fc1a4b679e063f5c70198a47/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.161037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-27a46d00-1fba-4921-873c-081f7df34bd0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.162254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-27a46d00-1fba-4921-873c-081f7df34bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.169771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7feae7e22154681b96d53317ea1b19f, user_id=5385c077fc1a4b679e063f5c70198a47, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.171621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 802/1611] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.172623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16c03-2e61-4368-8081-ae3e56fbfca4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.172739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.172999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.173238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.187253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 810/1612] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:19 2022] PUT /identity/v3/projects/a7feae7e22154681b96d53317ea1b19f/users/5385c077fc1a4b679e063f5c70198a47/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:19.189089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.189373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.189644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.202676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.203891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.210335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.211522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.275841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 803/1613] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.276871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.286590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 811/1614] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.286964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4a00e-6fc9-4919-ae5c-c5f279f82c04 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.287606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.288948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.292207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.292947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.293228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.293498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] PATH_INFO: `/v3/projects/531dda5a16b341a0bf1ebf85673426be/users/4d63a946bd33454caaa2827fa8b1d06f/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.296299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:19.310391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531dda5a16b341a0bf1ebf85673426be, user_id=4d63a946bd33454caaa2827fa8b1d06f, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.314382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.331688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 804/1615] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:19 2022] PUT /identity/v3/projects/531dda5a16b341a0bf1ebf85673426be/users/4d63a946bd33454caaa2827fa8b1d06f/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:19.332881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.336008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.364443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74acacd-0109-42a6-90a9-727f5dd6c19e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.410451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679dcc4-30a9-4c2c-bfbf-473dc4c44e87 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.414330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.415079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.415365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.415647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.425047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.425796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.426140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.426476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.430904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:19.492419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.493128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.493872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.494712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9ed0a-9d06-403e-914f-222e89fc9486 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.507371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 805/1616] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.507988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.509346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 812/1617] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.511020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.511539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.512342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.516727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3e872-1187-4e7a-a06b-e647032fc682 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.520685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.521296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.521581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.521857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.534527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.536412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.547705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] MFA Rules not processed for user `5385c077fc1a4b679e063f5c70198a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.549551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:19.551418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 806/1618] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.552375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.562053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e8ac-cd2a-4491-a5b5-06db7db7e8b5 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.568049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.568872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.569204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.569487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.583523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.585328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.599131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 807/1619] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.600145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.609315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d0620-a524-44cd-9c78-e314f98b06b1 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.614542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.615145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.615426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.615699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.629707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.631896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.637099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:19.648109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 808/1620] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:19.648606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 813/1621] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:19.649292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.650296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.663707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed000eff-1c02-4263-854c-0f111056a952 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.667313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8677b41-ed27-4c5f-b5b1-89486e52f4d1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.672390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.673552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.673833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.674103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.675111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.675350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.676196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.676484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.676611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.676986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.678389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.680724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.713538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 809/1622] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:19.715260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.724072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 814/1623] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:19.731320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.741574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48365e0-69d6-47c5-b1d3-da7eefc930d7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.827669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209981-4743-4bb6-ae74-9bbc8f04ddf2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.838251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.838908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.841422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.841712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.843836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.850539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.873767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:19.874440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.874723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.875084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] PATH_INFO: `/v3/projects/531dda5a16b341a0bf1ebf85673426be/users/4d63a946bd33454caaa2827fa8b1d06f/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.878374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=531dda5a16b341a0bf1ebf85673426be, user_id=4d63a946bd33454caaa2827fa8b1d06f, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:19.882983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b6917-8e02-4ccf-bcb7-720ce96718cc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:19.892011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 815/1624] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:19.897364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:19.920368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 810/1625] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:19 2022] PUT /identity/v3/projects/531dda5a16b341a0bf1ebf85673426be/users/4d63a946bd33454caaa2827fa8b1d06f/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:19.925076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dee53a-0b28-4c2e-95c4-c2f075dc3151 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:19.934610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:19.935673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:19.936283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:19.986341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] MFA Rules not processed for user `4d63a946bd33454caaa2827fa8b1d06f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:19.989079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:20.016657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.018116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.018657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.019180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.020224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.023660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.046974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 816/1626] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:20.049033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.060623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:20.068921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807b82-7bc0-4341-b2a6-77bcc441da98 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.079747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.080483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.081307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.081771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] PATH_INFO: `/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da/users/c1c209386e23469683b2a1ef1d2d545e/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.099266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 811/1627] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:20.110814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.113860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdd2aa7a0d342c5bca12705a05af5da, user_id=c1c209386e23469683b2a1ef1d2d545e, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.117725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.145935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 817/1628] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:20 2022] PUT /identity/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da/users/c1c209386e23469683b2a1ef1d2d545e/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:20.147116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.229179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:20.263001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b029d9-9a82-452b-8992-de74fcc7dcb9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.268946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.269109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d211a9c-f0f4-4992-be65-790549cac59a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.269578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.269862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.270187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.270932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.272931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.288932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 818/1629] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:20.295652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.317327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad3e8-0262-4faa-a6b1-bdfc5f5d6f64 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.322773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.323633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.323980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.324463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] PATH_INFO: `/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da/users/c1c209386e23469683b2a1ef1d2d545e/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.328442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdd2aa7a0d342c5bca12705a05af5da, user_id=c1c209386e23469683b2a1ef1d2d545e, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.333115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f45c-798f-443a-a8b7-a8c43704541f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.359993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 819/1630] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:20 2022] PUT /identity/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da/users/c1c209386e23469683b2a1ef1d2d545e/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:20.361891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.362313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.362549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.375380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.377973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.378397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.380106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.421228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] MFA Rules not processed for user `c1c209386e23469683b2a1ef1d2d545e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:20.423236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:20.526185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.529782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.552285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 812/1631] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:40:20.568930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 820/1632] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:20.583288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.594607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550fb7f-6669-4742-a5a9-5717b3584226 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.696798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:20.703715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.704134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.704858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.705980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.705980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.717667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.722211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.730989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c53377-004c-463b-a8db-49a347096a70 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.737955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.738699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 813/1633] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:20.740920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.741208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.741483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:20.823091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:20.824602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b42160-ed59-41c6-906c-622f5c2a4a64 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:20.835757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 821/1634] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:20.896908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:20.906826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e741c-6d93-403a-a1fa-5dd57e70872d service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:20.923777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:20.924944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:20.924944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:20.924944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:21.044405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:21.046990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:21.059409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 814/1635] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:22.309528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:22.310308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:22.310308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:22.379195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] MFA Rules not processed for user `3d7667f4b70e4dfa88c6826ca8d4b02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:22.380501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:22.476044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:22.588428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 822/1636] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:22.593428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:22.736750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499685ce-7ba2-42a6-92d2-fb6cb363e95a service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:22.750727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:22.753209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:22.754601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:22.755412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:22.756664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:22.762119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:22.857010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 815/1637] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:22 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:22.861196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:22.881932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c9314-c7b3-45d6-951f-38c72125ed39 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:23.010387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:23.011102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:23.011391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:23.011661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:23.016747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:23.021116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:23.068244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 823/1638] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:22 2022] POST /identity/v3/users => generated 309 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:23.071769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:23.093593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57b3b-ab76-4583-a37c-f485457566c9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:23.101448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:23.102221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:23.102635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:23.103013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:23.103772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:23.106227 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:23.158751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 816/1639] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:23.158962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:23.177328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b705-796c-4fe6-8311-c297bd2843b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:23.193664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:23.194392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:23.194939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:23.195061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] PATH_INFO: `/v3/projects/73938955f7114e8f8aed77d4cc09909a/users/261f8f9d22b749d29515d684ed6c02db/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:23.224142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73938955f7114e8f8aed77d4cc09909a, user_id=261f8f9d22b749d29515d684ed6c02db, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:23.229493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:23.250161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 824/1640] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:23 2022] PUT /identity/v3/projects/73938955f7114e8f8aed77d4cc09909a/users/261f8f9d22b749d29515d684ed6c02db/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:23.254846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:23.268791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e0fe-c1cf-4771-8729-aa18665ff1fe admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:23.352115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:23.352922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:23.353281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:23.353686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:23.354953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:23.356729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88f743-5786-4358-a317-e004ef355be2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:23.359805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:23.376103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:23.385182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 817/1641] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:23.390633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8f7f-951a-4088-8d0b-b340b5247989 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:23.397424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:23.398898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:23.399267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:23.399720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] PATH_INFO: `/v3/projects/73938955f7114e8f8aed77d4cc09909a/users/261f8f9d22b749d29515d684ed6c02db/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:23.402445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73938955f7114e8f8aed77d4cc09909a, user_id=261f8f9d22b749d29515d684ed6c02db, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:23.405746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb099cce-ab5d-4a22-9070-af23c4f4fc74 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:23.421369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 825/1642] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:23 2022] PUT /identity/v3/projects/73938955f7114e8f8aed77d4cc09909a/users/261f8f9d22b749d29515d684ed6c02db/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:24.732353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee55d4-787e-4734-8cdb-d0382e206122 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:24.732867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee55d4-787e-4734-8cdb-d0382e206122 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:24.771361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee55d4-787e-4734-8cdb-d0382e206122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:24.790281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-caee55d4-787e-4734-8cdb-d0382e206122 None None] MFA Rules not processed for user `261f8f9d22b749d29515d684ed6c02db`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:24.791718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-caee55d4-787e-4734-8cdb-d0382e206122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:24.896110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 818/1643] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:26.805104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2e4a-924c-4412-a9a4-42353d443cff None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:26.806062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2e4a-924c-4412-a9a4-42353d443cff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:26.806494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2e4a-924c-4412-a9a4-42353d443cff None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:26.809673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 826/1644] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:40:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:26.818507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a147d-b6f1-44e6-bcf3-c08f1500e3a7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:26.819407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a147d-b6f1-44e6-bcf3-c08f1500e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:26.819655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a147d-b6f1-44e6-bcf3-c08f1500e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:26.881528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3a4a147d-b6f1-44e6-bcf3-c08f1500e3a7 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:26.885666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3a4a147d-b6f1-44e6-bcf3-c08f1500e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:27.060163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 819/1645] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:27.123319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6030c-b670-4056-8405-018b76aadeee None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:27.123724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6030c-b670-4056-8405-018b76aadeee None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:27.123869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6030c-b670-4056-8405-018b76aadeee None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:27.125292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 827/1646] 10.222.0.73 () {54 vars in 961 bytes} [Thu Aug 18 16:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:40:27.131839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:27.132168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:27.132453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:27.190867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:27.193418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:27.205854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 820/1647] 10.222.0.73 () {58 vars in 1058 bytes} [Thu Aug 18 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:27.218375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6030c-b670-4056-8405-018b76aadeee None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:27.258816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6030c-b670-4056-8405-018b76aadeee None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:27.275383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:27.276659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:27.277099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:27.279574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:27.320381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:27.324749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0193-6b42-4609-b757-b4ae46ff424e service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:27.368202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 828/1648] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:27.605591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:27.852177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc46f8-524c-44d3-bf5f-b773c93e5791 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:27.874986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:27.876555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:27.877353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:27.877766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] PATH_INFO: `/v3/users/a9156ad514af481ab39827cf9aca2c72` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:27.879382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9156ad514af481ab39827cf9aca2c72)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:27.881713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:27.918618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:28.010787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9156ad514af481ab39827cf9aca2c72'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:28.011571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9156ad514af481ab39827cf9aca2c72'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:28.026592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9156ad514af481ab39827cf9aca2c72'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:28.042403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9156ad514af481ab39827cf9aca2c72'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:28.043554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9156ad514af481ab39827cf9aca2c72'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:28.101601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 821/1649] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:27 2022] DELETE /identity/v3/users/a9156ad514af481ab39827cf9aca2c72 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:28.105674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:28.106169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:28.106256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:28.158104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:28.159973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:28.372130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 829/1650] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:28.395082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:28.396994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:28.488643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd3c2-cb9f-42ad-b7a2-e6dcb0027bde admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:28.499749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:28.500425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:28.500909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:28.501188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:28.514276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:28.515759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:28.528786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 822/1651] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:29.884394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:29.887154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:29.915584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95f6f0-bad1-4306-afc6-727e8a0bfa24 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:29.931267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:29.932401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:29.932889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:29.934929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] PATH_INFO: `/v3/users/5385c077fc1a4b679e063f5c70198a47` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:29.936483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5385c077fc1a4b679e063f5c70198a47)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:29.938652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:29.938652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 18 16:40:29.938652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: Aug 18 16:40:29.940351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:29.957154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:30.104107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5385c077fc1a4b679e063f5c70198a47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.106848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5385c077fc1a4b679e063f5c70198a47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.128363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:30.130627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:30.161244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5385c077fc1a4b679e063f5c70198a47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.162106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5385c077fc1a4b679e063f5c70198a47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.164295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869bd5-793d-4a93-8ded-ae227b705ad2 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:30.173050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-415c3b6f-93ce-4c61-9416-24d7cd5dd574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5385c077fc1a4b679e063f5c70198a47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.184845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:30.186110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:30.186845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:30.187346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] PATH_INFO: `/v3/projects/1024d10a927a4266bef3ed73b244093a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:30.189662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1024d10a927a4266bef3ed73b244093a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:30.191016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: WARNING py.warnings [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:40:30.191016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: warnings.warn(msg) Aug 18 16:40:30.191016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: Aug 18 16:40:30.193336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:30.205119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 830/1652] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:29 2022] DELETE /identity/v3/users/5385c077fc1a4b679e063f5c70198a47 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:30.209447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:30.209740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:30.210019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:30.245911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:30.249340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:30.296898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1024d10a927a4266bef3ed73b244093a', 'request_id': 'req-9f55f7f8-b692-4366-ad2a-83df2d53134f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.314217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1024d10a927a4266bef3ed73b244093a', 'request_id': 'req-9f55f7f8-b692-4366-ad2a-83df2d53134f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.324828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1024d10a927a4266bef3ed73b244093a', 'request_id': 'req-9f55f7f8-b692-4366-ad2a-83df2d53134f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.362611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] The token cache is being invalidate because project 1024d10a927a4266bef3ed73b244093a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:30.363508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.365727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.373426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 823/1653] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:30 2022] DELETE /identity/v3/projects/1024d10a927a4266bef3ed73b244093a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:30.375140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:30.381434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 831/1654] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:30.388273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:30.426189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f7f8-b692-4366-ad2a-83df2d53134f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:30.439342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:30.444970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:30.445256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:30.445538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] PATH_INFO: `/v3/users/4d63a946bd33454caaa2827fa8b1d06f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:30.457024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d63a946bd33454caaa2827fa8b1d06f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:30.459006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:30.474548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:30.475569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:30.476485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:30.555441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d63a946bd33454caaa2827fa8b1d06f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.556168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d63a946bd33454caaa2827fa8b1d06f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.582665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d63a946bd33454caaa2827fa8b1d06f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.610009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d63a946bd33454caaa2827fa8b1d06f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.617437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d63a946bd33454caaa2827fa8b1d06f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:30.649100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b887-69d4-4542-a3ae-fc7408de7925 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:30.653963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 824/1655] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:30 2022] DELETE /identity/v3/users/4d63a946bd33454caaa2827fa8b1d06f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:30.662864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:30.665687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:30.665985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:30.666245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:30.670054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:30.703157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:30.705357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201d1db-b931-44a4-9c52-c1cfc1547197 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:30.735327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 832/1656] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:40:31.574999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:31.576566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:31.728095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356935-fb22-4112-ad31-3e159867ddea admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:31.742573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec49-1663-4838-acc3-9b72c8a6828c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:31.743446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec49-1663-4838-acc3-9b72c8a6828c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:31.743640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29ec49-1663-4838-acc3-9b72c8a6828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:31.749027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:31.749992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:31.750393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:31.750821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] PATH_INFO: `/v3/projects/531dda5a16b341a0bf1ebf85673426be` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:31.752406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=531dda5a16b341a0bf1ebf85673426be)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:31.755350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:31.805366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3c29ec49-1663-4838-acc3-9b72c8a6828c None None] MFA Rules not processed for user `229ab54ddaee45dabf1c38d5d049528d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:31.806660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3c29ec49-1663-4838-acc3-9b72c8a6828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:31.832220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531dda5a16b341a0bf1ebf85673426be', 'request_id': 'req-4781f23c-6db2-4250-a50d-f8c87689c31d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:31.840584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531dda5a16b341a0bf1ebf85673426be', 'request_id': 'req-4781f23c-6db2-4250-a50d-f8c87689c31d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:31.843686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:31.855395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531dda5a16b341a0bf1ebf85673426be', 'request_id': 'req-4781f23c-6db2-4250-a50d-f8c87689c31d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:31.886977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] The token cache is being invalidate because project 531dda5a16b341a0bf1ebf85673426be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:31.887168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:31.887843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4781f23c-6db2-4250-a50d-f8c87689c31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:31.889729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 825/1657] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:31 2022] DELETE /identity/v3/projects/531dda5a16b341a0bf1ebf85673426be => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:31.890887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7720-8316-4947-ba54-21d0e9d4ed8d None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:31.891203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7720-8316-4947-ba54-21d0e9d4ed8d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:31.891481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7720-8316-4947-ba54-21d0e9d4ed8d None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:31.892859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 826/1658] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:31.893913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f63-2489-4923-85fd-f0de9e62ce2d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:31.894617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f63-2489-4923-85fd-f0de9e62ce2d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:31.894617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f63-2489-4923-85fd-f0de9e62ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:31.934662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2f1a2f63-2489-4923-85fd-f0de9e62ce2d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:31.935907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f1a2f63-2489-4923-85fd-f0de9e62ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:31.947199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 833/1659] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:31.952101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:31.999678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc53f-1050-43d6-a8fa-49b6573b423a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:31.999883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc53f-1050-43d6-a8fa-49b6573b423a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.000511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dc53f-1050-43d6-a8fa-49b6573b423a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.001842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 834/1660] 10.222.0.73 () {54 vars in 962 bytes} [Thu Aug 18 16:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:32.021810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23a84-b267-43e7-9690-d3359f51b0f5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.022318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23a84-b267-43e7-9690-d3359f51b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.022732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e23a84-b267-43e7-9690-d3359f51b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.027954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 827/1661] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:32.037357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.037778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.038170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.070825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:32.072396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.090501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 828/1662] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:32.091571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.102938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b68d7-6653-40d3-be7d-904364ad5c67 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.108038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.108876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.109939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.109939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.110119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-02e23a84-b267-43e7-9690-d3359f51b0f5 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:32.110653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:32.110944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-02e23a84-b267-43e7-9690-d3359f51b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.111158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.112968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.131330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 829/1663] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:32.136189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.153990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a47394-4242-45a6-8985-c24feca79d81 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.171334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.172259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.172957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.173370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.175600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.180359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.260947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 835/1664] 10.222.0.73 () {58 vars in 1059 bytes} [Thu Aug 18 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:32.262151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.262662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.262944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.273832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 830/1665] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:32 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:40:32.274995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.287208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] MFA Rules not processed for user `847ca98f731045cda90924197d3b800d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:32.292033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.434442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 836/1666] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:32.435456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.438873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc7e30-f6d3-420b-b288-e91e307b6798 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.452942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.453563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.456680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.456965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.519613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:32.565927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895f53a-05cd-43cc-808d-992e09713f05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.577613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.581162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.585405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.586029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.586795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.586795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.587175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.589275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.603756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 831/1667] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:32.604642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.607983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.631913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 837/1668] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:32 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:32.632875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.637361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.643124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c6d3-aa4c-4fc8-89a1-d9ce0dba2c41 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.652991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.654801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.655080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.655631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] PATH_INFO: `/v3/users/3d7667f4b70e4dfa88c6826ca8d4b02a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.659097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7667f4b70e4dfa88c6826ca8d4b02a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.663561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.670297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576f323-5d2d-40a4-b551-0d7db6499a92 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.682977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.685018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.685301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.685573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.692441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:32.705266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.706892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.733082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 838/1669] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:32.734150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.755059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7667f4b70e4dfa88c6826ca8d4b02a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:32.755790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7667f4b70e4dfa88c6826ca8d4b02a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:32.766836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7667f4b70e4dfa88c6826ca8d4b02a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:32.777471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7667f4b70e4dfa88c6826ca8d4b02a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:32.778565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7667f4b70e4dfa88c6826ca8d4b02a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:32.785074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db132ecb-2670-4d62-9e0d-5b213efb3344 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.794032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.794657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.795016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.795195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.795840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.798419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:32.818737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 832/1670] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:32 2022] DELETE /identity/v3/users/3d7667f4b70e4dfa88c6826ca8d4b02a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:32.826319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 839/1671] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:32.830154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:32.831624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:32.977565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56780c1f-4258-4623-ab90-44b667349297 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:32.983795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:32.984458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:32.984784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:32.985594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:32.986243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:32.988444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58ac20-e048-4e74-b2dd-0fbd7f13954b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:33.007107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 833/1672] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:33.008533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:33.023020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967cde5-9ed2-4537-b276-556f2aa7ddf2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:33.036564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:33.037759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:33.038150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:33.038437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] PATH_INFO: `/v3/projects/5f536e94066f4d0999ecc19343f7359a/users/b8b3ab2cfab14d1bb86bebffba48f29b/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:33.084953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f536e94066f4d0999ecc19343f7359a, user_id=b8b3ab2cfab14d1bb86bebffba48f29b, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:33.087864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:33.118169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 840/1673] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:33 2022] PUT /identity/v3/projects/5f536e94066f4d0999ecc19343f7359a/users/b8b3ab2cfab14d1bb86bebffba48f29b/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:33.129165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:33.129684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:33.130113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:33.206137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] MFA Rules not processed for user `b8b3ab2cfab14d1bb86bebffba48f29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:33.208890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:33.358525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 834/1674] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:33.360601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:33.437165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:33.438785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:33.483794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:33.567488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2984a-adce-46a4-8ee2-085ce5e8fca1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:33.591282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:33.606158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:33.607736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:33.611903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:33.612958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:33.616427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:33.705256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfa92a-7189-46b5-8599-c474f878f896 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:33.714401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 841/1675] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:33 2022] POST /identity/v3/projects => generated 383 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:33.714401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:33.714401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:33.729320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:33.732665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:33.742662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:33.743149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] PATH_INFO: `/v3/projects/a7feae7e22154681b96d53317ea1b19f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:33.745405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7feae7e22154681b96d53317ea1b19f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:33.753969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:33.904303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7feae7e22154681b96d53317ea1b19f', 'request_id': 'req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:33.909015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a800c0-240b-42f4-b414-121d8ec19c1e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:33.913515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7feae7e22154681b96d53317ea1b19f', 'request_id': 'req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:33.926755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7feae7e22154681b96d53317ea1b19f', 'request_id': 'req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:33.931033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:33.978809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] The token cache is being invalidate because project a7feae7e22154681b96d53317ea1b19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:33.979125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:33.981287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:33.984981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 835/1676] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:33 2022] DELETE /identity/v3/projects/a7feae7e22154681b96d53317ea1b19f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:33.987440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:33.991954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:34.108013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:34.110901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:34.111189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:34.111465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] PATH_INFO: `/v3/projects/4c8b1d95641d4d3fb9d8f41d48e1a5c0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:34.112713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8b1d95641d4d3fb9d8f41d48e1a5c0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:34.114656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:34.253156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c62fc-d5b2-48a4-a2c4-6d2bfe4d6cb3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:34.265737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8b1d95641d4d3fb9d8f41d48e1a5c0', 'request_id': 'req-7b516165-11c7-47fa-a4b9-5a43c675849a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.286493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8b1d95641d4d3fb9d8f41d48e1a5c0', 'request_id': 'req-7b516165-11c7-47fa-a4b9-5a43c675849a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.301195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8b1d95641d4d3fb9d8f41d48e1a5c0', 'request_id': 'req-7b516165-11c7-47fa-a4b9-5a43c675849a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.355692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] The token cache is being invalidate because project 4c8b1d95641d4d3fb9d8f41d48e1a5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:34.355692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.356485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.369177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 842/1677] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:33 2022] DELETE /identity/v3/projects/4c8b1d95641d4d3fb9d8f41d48e1a5c0 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:34.369177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:34.377327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:34.405033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:34.464880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:34.465982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:34.466409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:34.466760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:34.467506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:34.469815 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:34.507388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 836/1678] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:33 2022] POST /identity/v3/users => generated 298 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:34.507388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:34.513843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:34.518542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b516165-11c7-47fa-a4b9-5a43c675849a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:34.532877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:34.533889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:34.533889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:34.534201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] PATH_INFO: `/v3/users/c1c209386e23469683b2a1ef1d2d545e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:34.535253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c209386e23469683b2a1ef1d2d545e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:34.537281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:34.543939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6444ed1-bdba-4c37-8243-16b0f50ff30d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:34.555199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:34.556196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:34.556509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:34.556903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] PATH_INFO: `/v3/users/261f8f9d22b749d29515d684ed6c02db` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:34.560591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261f8f9d22b749d29515d684ed6c02db)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:34.564156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:34.676570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:34.694020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c209386e23469683b2a1ef1d2d545e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.695076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c209386e23469683b2a1ef1d2d545e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.714719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261f8f9d22b749d29515d684ed6c02db'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.725035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261f8f9d22b749d29515d684ed6c02db'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.753202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261f8f9d22b749d29515d684ed6c02db'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.759598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c209386e23469683b2a1ef1d2d545e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.760902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c209386e23469683b2a1ef1d2d545e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.775204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261f8f9d22b749d29515d684ed6c02db'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.776615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261f8f9d22b749d29515d684ed6c02db'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.783290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c209386e23469683b2a1ef1d2d545e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:34.824140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 843/1679] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:34 2022] DELETE /identity/v3/users/c1c209386e23469683b2a1ef1d2d545e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:34.826743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:34.833403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:34.841317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 837/1680] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:34 2022] DELETE /identity/v3/users/261f8f9d22b749d29515d684ed6c02db => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:35.001212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82678d7-088f-4a81-9f41-865fd818d8c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:35.105018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:35.105761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.106155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.106535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.107304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:35.109121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:35.122712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 844/1681] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:35.127330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:35.131388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:35.147244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e653e-e78d-43f5-a7fa-68aafde97447 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:35.152734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:35.154821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.156438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.157420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] PATH_INFO: `/v3/projects/ded745174f1e4eb4893efefedfe66016/users/e961413737e74c78b7e5e7535b1d2507/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.189436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded745174f1e4eb4893efefedfe66016, user_id=e961413737e74c78b7e5e7535b1d2507, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:35.192669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:35.244387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:35.245316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 838/1682] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:35 2022] PUT /identity/v3/projects/ded745174f1e4eb4893efefedfe66016/users/e961413737e74c78b7e5e7535b1d2507/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:35.257528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8bb87-545d-4214-9a0b-dbb8f2bbc167 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:35.378775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:35.380338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.380691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.381077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.382208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:35.384376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785cc48-39fa-4bdc-9358-a990592a199f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:35.387102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:35.402089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 845/1683] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:35.406340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:35.436497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984afe83-e612-4d62-bea6-8d19f771607e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:35.447323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:35.449161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.449913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.450327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] PATH_INFO: `/v3/projects/ded745174f1e4eb4893efefedfe66016/users/e961413737e74c78b7e5e7535b1d2507/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.452746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded745174f1e4eb4893efefedfe66016, user_id=e961413737e74c78b7e5e7535b1d2507, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:35.460156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:35.499085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.499352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.499630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.505673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 839/1684] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:35 2022] PUT /identity/v3/projects/ded745174f1e4eb4893efefedfe66016/users/e961413737e74c78b7e5e7535b1d2507/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:35.611762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] MFA Rules not processed for user `e961413737e74c78b7e5e7535b1d2507`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:35.616761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:35.791557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 846/1685] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:35.803837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:35.805768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:35.892097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710611-0e3b-4e7e-ab60-c2664cf0db85 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:35.896226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:35.896955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:35.897245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:35.897523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:35.912015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:35.914033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:35.928496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 840/1686] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:36.068125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:36.083592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e22416-6d7d-492f-800e-ac1c2c1d9da3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:36.092853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:36.095605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.096091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.097353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.101533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.175048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:36.177612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.227385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:36.236200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:36.239064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07098895-119d-4da4-9aa7-abfc5cbc8fe9 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:36.270102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 847/1687] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:40:36.353951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512ad1-ef62-440e-b825-d942778324a6 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:36.371018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:36.371870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.371985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.372403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] PATH_INFO: `/v3/projects/73938955f7114e8f8aed77d4cc09909a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.376255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73938955f7114e8f8aed77d4cc09909a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:36.388566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:36.519702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73938955f7114e8f8aed77d4cc09909a', 'request_id': 'req-d0606c5c-ade4-4894-b137-475764d21e24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.537380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73938955f7114e8f8aed77d4cc09909a', 'request_id': 'req-d0606c5c-ade4-4894-b137-475764d21e24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.555775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73938955f7114e8f8aed77d4cc09909a', 'request_id': 'req-d0606c5c-ade4-4894-b137-475764d21e24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.574579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] The token cache is being invalidate because project 73938955f7114e8f8aed77d4cc09909a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:36.574870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.578087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.586823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 841/1688] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:36 2022] DELETE /identity/v3/projects/73938955f7114e8f8aed77d4cc09909a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:36.590466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fca5-db07-4d27-90fa-0c3767615f46 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.590758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fca5-db07-4d27-90fa-0c3767615f46 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.591039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fca5-db07-4d27-90fa-0c3767615f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.648350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d077fca5-db07-4d27-90fa-0c3767615f46 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:36.652724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d077fca5-db07-4d27-90fa-0c3767615f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.774903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:36.776009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 848/1689] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:36.783516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.785679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.786049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.786619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.823436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:36.824398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.824643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c5c-ade4-4894-b137-475764d21e24 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:36.837896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 849/1690] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:36.839191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:36.841072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:36.841817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:36.842468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.842747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.843014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] PATH_INFO: `/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.846518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdd2aa7a0d342c5bca12705a05af5da)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:36.848139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:36.854442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0108e-1ef1-41b7-b972-eab93a9e916f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:36.882798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:36.883375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:36.883666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:36.883942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] PATH_INFO: `/v3/users/b8b3ab2cfab14d1bb86bebffba48f29b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:36.885759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b3ab2cfab14d1bb86bebffba48f29b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:36.888748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:36.914949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:36.953549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdd2aa7a0d342c5bca12705a05af5da', 'request_id': 'req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:36.981732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdd2aa7a0d342c5bca12705a05af5da', 'request_id': 'req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.003854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdd2aa7a0d342c5bca12705a05af5da', 'request_id': 'req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.019831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] The token cache is being invalidate because project 6bdd2aa7a0d342c5bca12705a05af5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:37.020213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.021340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.024220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b3ab2cfab14d1bb86bebffba48f29b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.026423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b3ab2cfab14d1bb86bebffba48f29b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.026586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 842/1691] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:36 2022] DELETE /identity/v3/projects/6bdd2aa7a0d342c5bca12705a05af5da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:37.027671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.029155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.076864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b3ab2cfab14d1bb86bebffba48f29b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.077559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b3ab2cfab14d1bb86bebffba48f29b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.091975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9425a146-70a3-49f8-b1d7-7cc3ede3686a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b3ab2cfab14d1bb86bebffba48f29b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:37.104400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:37.136728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 850/1692] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:36 2022] DELETE /identity/v3/users/b8b3ab2cfab14d1bb86bebffba48f29b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:37.138385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6406-8339-4561-845e-824eac557ab9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.138385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6406-8339-4561-845e-824eac557ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.138584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e6406-8339-4561-845e-824eac557ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.175430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9910f-f457-4ef3-82cc-24c5a5e3e833 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.204467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-546e6406-8339-4561-845e-824eac557ab9 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:37.205725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-546e6406-8339-4561-845e-824eac557ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.335431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 851/1693] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:37.337089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.337961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.338800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.345936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.347611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.348526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.348903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.351710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:37.352802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.356805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f374e7e-bda4-455b-bd88-92d367cff2f0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:37.384858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 843/1694] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:37.386313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bf141-8d2f-4726-abe2-214341b5bf75 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.386602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bf141-8d2f-4726-abe2-214341b5bf75 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.386931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bf141-8d2f-4726-abe2-214341b5bf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.417711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:37.418955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.447675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 852/1695] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:37.447675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.448950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.464468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2126-01dc-40f8-8d1c-aef5380d0035 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.471313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-024bf141-8d2f-4726-abe2-214341b5bf75 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:37.473761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-024bf141-8d2f-4726-abe2-214341b5bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.481564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.482508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.483172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.483569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.485700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.490267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:37.498473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 844/1696] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:37.498473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.498473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.498473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.529957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 853/1697] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:37.530981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.533481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.536484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] MFA Rules not processed for user `2ef6382c2b9e416c95938c18c0c79307`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:37.537836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.601712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1569-ea42-4047-bd24-79b75c90a8ce admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.605504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.606124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.606405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.606680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.621241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:37.653850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 845/1698] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:37.655554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.711144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.720307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:37.751385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 854/1699] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:37.752915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.771042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133274f4-3909-4307-838c-5987873e2392 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.826469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:37.831539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.833755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.834055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.834390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.835033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.842611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:37.845486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8dab2-12d0-4f23-b09b-d4b90614e4d5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.860390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.861189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.861473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.861750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.862407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:37.862711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.871908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef42ed-149f-48da-8b19-fd5160b52045 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:37.907801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 846/1700] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:37.907801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.907801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.907801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.920867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 855/1701] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:37.923585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:37.945672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5bb9-b4a3-4e9c-bde7-028da76c53b2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:37.966357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] MFA Rules not processed for user `2ef6382c2b9e416c95938c18c0c79307`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:37.968934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:37.970681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:37.971317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:37.971600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:37.971871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:37.972531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:37.974465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.007964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 847/1702] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:38.010147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.033964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 856/1703] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:37 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:38.038114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.076966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b01f5-fac9-49eb-b56f-e7d9d2f09e7f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.216296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972603-47eb-4bc1-b73d-e760eb01cb29 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.228266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.229317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.229739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.230158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.230949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.231744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.232520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.232912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.233357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.234111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.239676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8fdcc-4d77-4ebd-9a37-c0b0bb0cdcd6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.239993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6f57-fb0b-4925-8aac-189c1bd9f168 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.261403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 848/1704] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:38.267023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe437-e768-425f-9f04-6c96c05b5c81 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.267364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe437-e768-425f-9f04-6c96c05b5c81 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.267690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fe437-e768-425f-9f04-6c96c05b5c81 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.276685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 849/1705] 10.222.0.73 () {54 vars in 962 bytes} [Thu Aug 18 16:40:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:38.277692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fe437-e768-425f-9f04-6c96c05b5c81 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.297109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 857/1706] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:38 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:40:38.301279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.302047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.303805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.313594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fe437-e768-425f-9f04-6c96c05b5c81 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.329840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.330701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.331150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.331557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.335828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.337689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.344953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:38.346957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:38.363895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 850/1707] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:38.364992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.388321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820d44-a8de-4b9b-bfe3-a902eb3bc6ca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.402461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.403386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.403812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.404268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.405081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.407737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.436111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 851/1708] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:38.437175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.475416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7110-13f3-446c-bb69-f5a6a15b86ee admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.502520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.506041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.506325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.506605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] PATH_INFO: `/v3/projects/229def8439694a7fb5fa36193e16b369/users/599bfe9d74334544a37fd27f7e2f3012/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.523046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:38.562337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229def8439694a7fb5fa36193e16b369, user_id=599bfe9d74334544a37fd27f7e2f3012, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.573932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.584865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 858/1709] 10.222.0.73 () {58 vars in 1059 bytes} [Thu Aug 18 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:38.586113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.609071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6280b1-98cb-4dda-98c8-d7a3c8052f8b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.630936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 852/1710] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:38 2022] PUT /identity/v3/projects/229def8439694a7fb5fa36193e16b369/users/599bfe9d74334544a37fd27f7e2f3012/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:38.631813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:38.749035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.749795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.750205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.750622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.752362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.756001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc977b-4305-4737-965f-138e5d34e29c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:38.778986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 859/1711] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:38.787131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.791434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.791888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.839165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c2fab-9c65-4b51-82bd-77a6e4b87fb7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:38.861949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:38.862595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:38.862877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:38.863152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:38.883824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] MFA Rules not processed for user `599bfe9d74334544a37fd27f7e2f3012`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:38.890325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:38.943366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:38.991801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:38.993906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.006010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 853/1712] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:39.007644 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.019989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306753bd-3588-43d6-b254-93e23ee62d68 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.024784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.025600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.025963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.026314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] PATH_INFO: `/v3/projects/9b57c59b6f9f448bb0b62b83f1ec1bcf/users/085b42866d8f4c6ea40ecb3896a5de91/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.055663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57c59b6f9f448bb0b62b83f1ec1bcf, user_id=085b42866d8f4c6ea40ecb3896a5de91, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.059025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbed4d-5707-4f18-8f9a-90859906e32d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.098664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 854/1713] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:39 2022] PUT /identity/v3/projects/9b57c59b6f9f448bb0b62b83f1ec1bcf/users/085b42866d8f4c6ea40ecb3896a5de91/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:39.112264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.112552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.112832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.130190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 860/1714] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:39.132370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.150114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] MFA Rules not processed for user `085b42866d8f4c6ea40ecb3896a5de91`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:39.151509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:39.174673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620005e6-2efa-435b-8ba9-f5f9ae7f8521 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.294412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 855/1715] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:39.295425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.340780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.342077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.342366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.342642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.343331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.346309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.426511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 861/1716] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:39 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:39.432469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.437243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:39.468958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46b536-984e-4687-8957-25b50bba9c77 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.575214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:39.593759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0e55-6145-4222-97d0-feb1ed76db79 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.603567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.604247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.604529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.604801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.605431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.607624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.620576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.621218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.621501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.621772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.622417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.624405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.662934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 862/1717] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:39 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:39.667186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.682957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 856/1718] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:39 2022] POST /identity/v3/projects => generated 369 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:39.687098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.687508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77efa-6bf3-48e3-a22c-1a5eb7226712 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.809108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5736439-f33a-4591-84d2-5e8881f8c0f1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.823544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.823862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.824171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.824449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.828942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.836907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.838086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.838086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.838483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.841354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.842349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.846632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.885691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 863/1719] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:39.889667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.906868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 857/1720] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:39 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:40:39.914550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1b851-51d1-4ece-a946-ef1febe619a8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.915353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:39.919910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:39.929714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.930554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.932462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.933174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] PATH_INFO: `/v3/projects/8f3471227ea34e4592e769e68ee04ceb/users/fb356757279a4771bb787388a012a0e8/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.950975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182a6b9-16c8-4196-ae9a-fc41d192d29a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:39.963837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:39.964544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:39.964833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:39.965116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] PATH_INFO: `/v3/projects/5f536e94066f4d0999ecc19343f7359a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:39.966503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f536e94066f4d0999ecc19343f7359a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.970329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:39.970740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3471227ea34e4592e769e68ee04ceb, user_id=fb356757279a4771bb787388a012a0e8, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:39.977056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.003984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 864/1721] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:39 2022] PUT /identity/v3/projects/8f3471227ea34e4592e769e68ee04ceb/users/fb356757279a4771bb787388a012a0e8/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:40.006967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.092488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f536e94066f4d0999ecc19343f7359a', 'request_id': 'req-635087e0-73aa-49dd-a36f-3c2e794d7691'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.107088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f536e94066f4d0999ecc19343f7359a', 'request_id': 'req-635087e0-73aa-49dd-a36f-3c2e794d7691'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.124347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f536e94066f4d0999ecc19343f7359a', 'request_id': 'req-635087e0-73aa-49dd-a36f-3c2e794d7691'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.143833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764078d-1d3c-4ed4-9f6f-7ba7cf7b0bbd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:40.164216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] The token cache is being invalidate because project 5f536e94066f4d0999ecc19343f7359a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:40.167073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.167817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:40.171335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-635087e0-73aa-49dd-a36f-3c2e794d7691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.181083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 858/1722] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:39 2022] DELETE /identity/v3/projects/5f536e94066f4d0999ecc19343f7359a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:40.185731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.186235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.186682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.193093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 859/1723] 10.222.0.73 () {54 vars in 912 bytes} [Thu Aug 18 16:40:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:40.195301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.200867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.293593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:40.294235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.294516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.294790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.295439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:40.301194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.332087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 865/1724] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:40.332997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.344800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.357454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:40.390244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73aae5-6f2c-45dc-b9be-66414577bef1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:40.409112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:40.409986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.410102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.410301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] PATH_INFO: `/v3/users/e961413737e74c78b7e5e7535b1d2507` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.413615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e961413737e74c78b7e5e7535b1d2507)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:40.423235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.440425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa4f4-a93b-459b-82b8-891e1c1eed3a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:40.461089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:40.461903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.462184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.462441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.463145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:40.470579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916dbaa-c740-46f8-93ac-1b068c13261f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.500098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 860/1725] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:40.506621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.506911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.507187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.551056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e961413737e74c78b7e5e7535b1d2507'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.551899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e961413737e74c78b7e5e7535b1d2507'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.566112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:40.567470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.576403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e961413737e74c78b7e5e7535b1d2507'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.577146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e961413737e74c78b7e5e7535b1d2507'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.588042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e961413737e74c78b7e5e7535b1d2507'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:40.605926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 866/1726] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:40 2022] DELETE /identity/v3/users/e961413737e74c78b7e5e7535b1d2507 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:40.607003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.608603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.739748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 861/1727] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:40.740870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.744526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.761649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd8ac9-fc64-4312-9fc5-21bd3cab5868 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:40.771775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4de16-b669-428f-8c4c-2c47ef8fc9bc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:40.773016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:40.773463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.774168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.774448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] PATH_INFO: `/v3/projects/6c8ba52768624a26bc983bf13cb815ef/users/0c5bbfedad56425db24ec89a3433ce26/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.787017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:40.787817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.788140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.788372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] PATH_INFO: `/v3/projects/8f3471227ea34e4592e769e68ee04ceb/users/fb356757279a4771bb787388a012a0e8/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.792762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3471227ea34e4592e769e68ee04ceb, user_id=fb356757279a4771bb787388a012a0e8, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:40.795494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.821460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8ba52768624a26bc983bf13cb815ef, user_id=0c5bbfedad56425db24ec89a3433ce26, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:40.825117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd2ec6-1fea-4722-8e8d-a6cbeb80117b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:40.838473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 862/1728] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:40 2022] PUT /identity/v3/projects/8f3471227ea34e4592e769e68ee04ceb/users/fb356757279a4771bb787388a012a0e8/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:40.839433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:40.853912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:40.920824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 867/1729] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:40 2022] PUT /identity/v3/projects/6c8ba52768624a26bc983bf13cb815ef/users/0c5bbfedad56425db24ec89a3433ce26/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:40.923646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:40.926267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:40.926715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:40.943202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:41.000996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] MFA Rules not processed for user `fb356757279a4771bb787388a012a0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:41.002480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.046087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6af71-f051-41b3-8494-23f942269caa admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.136012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.136719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.137111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.137581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.144107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:41.156016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 868/1730] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:41.157484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.279008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:41.281408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:41.301077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c250b57-1973-46c5-a810-33e3d0df8849 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.307737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.308525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.309052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.309823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.310622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:41.312655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:41.317043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 863/1731] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:41.319190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.323114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.355013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 869/1732] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:41.357646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.381623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c713af-e000-4e81-8e5e-c736efcc9f90 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.387104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.388664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.389320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.389437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] PATH_INFO: `/v3/projects/6c8ba52768624a26bc983bf13cb815ef/users/0c5bbfedad56425db24ec89a3433ce26/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.393026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8ba52768624a26bc983bf13cb815ef, user_id=0c5bbfedad56425db24ec89a3433ce26, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:41.397456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ca5d-f8fa-4180-86b4-5e7eb9c60951 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:41.422571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 870/1733] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:41 2022] PUT /identity/v3/projects/6c8ba52768624a26bc983bf13cb815ef/users/0c5bbfedad56425db24ec89a3433ce26/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:41.424283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca01a-3bf5-4285-9089-5a1445d17d65 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.424570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca01a-3bf5-4285-9089-5a1445d17d65 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.425027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeca01a-3bf5-4285-9089-5a1445d17d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.447407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911236-1301-4ffb-8d6e-98ccb1a36683 service glance] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.488733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bdeca01a-3bf5-4285-9089-5a1445d17d65 None None] MFA Rules not processed for user `0c5bbfedad56425db24ec89a3433ce26`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:41.489961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdeca01a-3bf5-4285-9089-5a1445d17d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.517347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.518782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.519204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.519490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.597274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:41.615459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 871/1734] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:41.630677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.630971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.631244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.650307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:41.651802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:41.656210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:41.677776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 864/1735] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:41.678466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.679991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.682621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] MFA Rules not processed for user `d5cca2e6407147fd99a92e8f0132d08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:41.683759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.706465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89046c-b99f-4888-bce7-cb13957e3bb3 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.721665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.722193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.722477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.722754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.756990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:41.759345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:41.774523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 865/1736] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:41.867996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 872/1737] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:41.869048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.871514 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:41.900417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:41.927853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14741-6000-4d11-a1d5-c251a3486657 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:41.943471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:41.948340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:41.948688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:41.948972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:41.960003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.157745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4d9e6-338a-44ef-8b8e-b6a8b39751c7 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:42.186750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:42.187339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.187619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.188489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.199075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:42.201097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd5b9-930f-439e-b347-971ce5cc5c4c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:42.208205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:42.209758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c877e-a9f3-4f86-8be9-8dbc0c1f4509 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:42.232433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 866/1738] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:42.233734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.233850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 873/1739] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:42.234019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.234294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.236393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33ebc-feb1-4a9c-b08f-c27d429410d9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.236692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33ebc-feb1-4a9c-b08f-c27d429410d9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.237476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d33ebc-feb1-4a9c-b08f-c27d429410d9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.239420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 874/1740] 10.222.0.73 () {54 vars in 912 bytes} [Thu Aug 18 16:40:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:42.256294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edc464-5c46-4ac9-a48e-a810fd2516d5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.256619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edc464-5c46-4ac9-a48e-a810fd2516d5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.256864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edc464-5c46-4ac9-a48e-a810fd2516d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.290973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] MFA Rules not processed for user `229ab54ddaee45dabf1c38d5d049528d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:42.295690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.378821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c3edc464-5c46-4ac9-a48e-a810fd2516d5 None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:42.381619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3edc464-5c46-4ac9-a48e-a810fd2516d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.488340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 867/1741] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:42.569302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 875/1742] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:42.620540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:42.622049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.636333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b34e-a5a8-4426-a631-5a1fcf4ac01f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.636928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b34e-a5a8-4426-a631-5a1fcf4ac01f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.637391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159b34e-a5a8-4426-a631-5a1fcf4ac01f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.639091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 876/1743] 10.222.0.73 () {54 vars in 912 bytes} [Thu Aug 18 16:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:40:42.649242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac785f-0965-4829-9728-96b992d823ae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.649570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac785f-0965-4829-9728-96b992d823ae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.649793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac785f-0965-4829-9728-96b992d823ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.653287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18bdaa-d740-4acb-81d3-6d68813ecae3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:42.662016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:42.662651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.662934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.663210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.686080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:42.687829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6dac785f-0965-4829-9728-96b992d823ae None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:42.689574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6dac785f-0965-4829-9728-96b992d823ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.689824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:42.701909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 868/1744] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:42.719520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 877/1745] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:42.723664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:42.725675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.789442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac785f-0965-4829-9728-96b992d823ae None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:42.790858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6dac785f-0965-4829-9728-96b992d823ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:42.821685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:42.899777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e037-5a26-4b51-89d9-fd4c672885e9 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:42.925723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:42.927994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.928497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.929391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.933438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac785f-0965-4829-9728-96b992d823ae None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:42.946639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:42.948636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac416f4-036b-420e-a2e8-d0251cb03f02 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:42.948769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:42.949390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:42.949669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:42.950102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] PATH_INFO: `/v3/projects/ded745174f1e4eb4893efefedfe66016` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:42.951479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded745174f1e4eb4893efefedfe66016)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:42.953616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:42.991203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 869/1746] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:43.066475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded745174f1e4eb4893efefedfe66016', 'request_id': 'req-cee8d69b-999a-4074-ae54-a4b8f9591cb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:43.078588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded745174f1e4eb4893efefedfe66016', 'request_id': 'req-cee8d69b-999a-4074-ae54-a4b8f9591cb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:43.108565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded745174f1e4eb4893efefedfe66016', 'request_id': 'req-cee8d69b-999a-4074-ae54-a4b8f9591cb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:43.148547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] The token cache is being invalidate because project ded745174f1e4eb4893efefedfe66016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:43.149647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:43.151427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cee8d69b-999a-4074-ae54-a4b8f9591cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:43.155235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 878/1747] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:42 2022] DELETE /identity/v3/projects/ded745174f1e4eb4893efefedfe66016 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:43.161260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c5e2-e121-4b0b-9d38-472bf6fc128b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.161719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c5e2-e121-4b0b-9d38-472bf6fc128b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.161968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10c5e2-e121-4b0b-9d38-472bf6fc128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.189183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:43.214470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3a10c5e2-e121-4b0b-9d38-472bf6fc128b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:43.235637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3a10c5e2-e121-4b0b-9d38-472bf6fc128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:43.453168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75be6-6c35-4fdc-8891-c6e99e422beb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.454217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75be6-6c35-4fdc-8891-c6e99e422beb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.454511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75be6-6c35-4fdc-8891-c6e99e422beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.483038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 870/1748] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:43.485414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.485713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.485991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.521034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:43.522376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:43.541753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 871/1749] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:43.546561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:43.554967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a5b75be6-6c35-4fdc-8891-c6e99e422beb None None] MFA Rules not processed for user `453b6e46935f44d09271e2720e4c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:43.562480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31ea75-7cd3-4053-ab67-84affc42bd06 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:43.567044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a5b75be6-6c35-4fdc-8891-c6e99e422beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:43.579581 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:43.581097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.581548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.582016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.583058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:43.583569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:43.585818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:43.618683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 872/1750] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:43.619596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:43.651582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406a0ca-9a0a-4d36-a4d5-52909fd661d4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:43.676494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:43.677437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.677675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.678072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.679220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:43.682682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:43.778839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 873/1751] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:43.784413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:43.851010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 879/1752] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:43.855451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4099-4889-4137-9da5-f012f82af428 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:43.855935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4099-4889-4137-9da5-f012f82af428 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:43.856368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4099-4889-4137-9da5-f012f82af428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:43.930580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-930b4099-4889-4137-9da5-f012f82af428 None None] MFA Rules not processed for user `453b6e46935f44d09271e2720e4c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:43.935240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-930b4099-4889-4137-9da5-f012f82af428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:44.005001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141441a-b44b-4d65-99cb-705ee4cb96a2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.018036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.018667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.018947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.019224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.020721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.021869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:44.052000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:44.087976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 874/1753] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:44.088891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.111982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d58-caa3-47e0-acea-ab2174178e64 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.118510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 880/1754] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:44.148923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.149563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.149848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.150123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.150780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.153373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:44.173330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4099-4889-4137-9da5-f012f82af428 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.184341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 875/1755] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:44.195656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4099-4889-4137-9da5-f012f82af428 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.209103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.209740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.210027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.210381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.210948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.214237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:44.230694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 881/1756] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:44.235188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.259875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.265354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994288-b463-45ce-8a08-f98565f2ed92 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.272941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:44.298027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.301495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.301495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.301495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] PATH_INFO: `/v3/projects/f519d60bbf304124a0f3203bad426bc9/users/eb4816ffb3cb47cc90cb4d6ddac0319d/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.355787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f519d60bbf304124a0f3203bad426bc9, user_id=eb4816ffb3cb47cc90cb4d6ddac0319d, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.358548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957751e-845d-4034-9dd3-7bc6b6b18c6a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:44.428366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 876/1757] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:44 2022] PUT /identity/v3/projects/f519d60bbf304124a0f3203bad426bc9/users/eb4816ffb3cb47cc90cb4d6ddac0319d/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:44.435471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.435838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.436139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.478386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffbb23-bf4d-4f09-b800-36b72b53f531 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.545250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] MFA Rules not processed for user `eb4816ffb3cb47cc90cb4d6ddac0319d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:44.546714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:44.569206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:44.687743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.691569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.692036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.693064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.748558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 877/1758] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:44.749508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.757145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:44.874244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.879799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91320c51-dd7f-4ab8-a2d0-6ef181bc7a3d service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:44.899406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 882/1759] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:44.902704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521fe2-a762-4fc0-8df1-2efc5d13d0a6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.903186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521fe2-a762-4fc0-8df1-2efc5d13d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.903652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28521fe2-a762-4fc0-8df1-2efc5d13d0a6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.907157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 883/1760] 10.222.0.73 () {54 vars in 912 bytes} [Thu Aug 18 16:40:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:44.908265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521fe2-a762-4fc0-8df1-2efc5d13d0a6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:44.937371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9206c-737c-4904-b779-f99dbaad71bf None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:44.946942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:44.952783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:44.954491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:44.954912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:44.955346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:44.959414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:44.989188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:44.994808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689003-d0b3-4a14-b23d-69915e8c5d33 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.023217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 878/1761] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:45.024574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.024854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.028746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.096279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:45.097517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.107198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28521fe2-a762-4fc0-8df1-2efc5d13d0a6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:45.115791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:45.117089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.117551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.117995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.118934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:45.121596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.166220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 884/1762] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:45.168758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:45.170698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.230659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 879/1763] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:45.231674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:45.268013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736fd92-dd8a-4f8c-9e32-72cad6b9d72f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:45.351101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:45.380216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:45.380844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.381124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.381394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.382457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:45.384117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.401820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c941a2-5391-4852-9026-c69bf9f99994 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:45.414596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:45.414986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.415264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.415864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] PATH_INFO: `/v3/users/085b42866d8f4c6ea40ecb3896a5de91` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.417611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085b42866d8f4c6ea40ecb3896a5de91)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:45.420046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.429205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 880/1764] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:45 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:45.430370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:45.434257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.519058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085b42866d8f4c6ea40ecb3896a5de91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:45.520203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085b42866d8f4c6ea40ecb3896a5de91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:45.544497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085b42866d8f4c6ea40ecb3896a5de91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:45.545957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085b42866d8f4c6ea40ecb3896a5de91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:45.562002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085b42866d8f4c6ea40ecb3896a5de91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:45.598056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 885/1765] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:45 2022] DELETE /identity/v3/users/085b42866d8f4c6ea40ecb3896a5de91 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:45.598056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:45.599768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1914b93-4437-4497-a06a-b3b116a2d20b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:45.607330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.629316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:45.783931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:45.785531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.787087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.787529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.792308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.815626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25529ab8-50a0-4390-8176-0f13d6bf46e1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:45.829832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:45.833798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e676d-0d32-4b07-9f1c-f720384cb035 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.845143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:45.846091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.846091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.846316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.849360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:45.849360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7017481-5bba-420e-bb14-1a874393d214 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:45.870273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 886/1766] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:45.872278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 881/1767] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:45.873816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.877695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:45.877851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.878248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.878356 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:45.878745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:45.941736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:45.942994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.975643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] MFA Rules not processed for user `c19359f992c54313b7b1dfee4553f7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:45.978634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:45.981721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 887/1768] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:45.982523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:46.006865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9f28e-db6b-412a-bfc0-7d410a5feb27 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:46.027017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:46.027699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.027980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.028290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] PATH_INFO: `/v3/projects/25e6287be8e547b38949f5387e4caaf2/users/1ad178ee25a74afcbd8572d985f0bbd5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.084649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e6287be8e547b38949f5387e4caaf2, user_id=1ad178ee25a74afcbd8572d985f0bbd5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:46.087358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:46.126423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 888/1769] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:45 2022] PUT /identity/v3/projects/25e6287be8e547b38949f5387e4caaf2/users/1ad178ee25a74afcbd8572d985f0bbd5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:46.127649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:46.139944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:46.226739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 882/1770] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:46.227886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:46.261659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2dc1b-0c0b-43f6-a719-629ad46ef298 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:46.318655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891a4b9-9ff0-4d02-8ba9-4b12120cb4e1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:46.326790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:46.327412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.327699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.327975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.330057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:46.446616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:46.447163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.447447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.447722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.448409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:46.450071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:46.479904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 883/1771] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:46.484527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:46.498652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771dbf8-c710-424f-b37d-e8af92ce4591 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:46.510818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:46.513867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:46.515050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.516191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.516532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbcbee-e0ec-4c79-95c1-78757c62da43 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:46.516782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] PATH_INFO: `/v3/projects/25e6287be8e547b38949f5387e4caaf2/users/1ad178ee25a74afcbd8572d985f0bbd5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.520416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e6287be8e547b38949f5387e4caaf2, user_id=1ad178ee25a74afcbd8572d985f0bbd5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:46.523572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:46.539989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 889/1772] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:46.564254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 884/1773] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:46 2022] PUT /identity/v3/projects/25e6287be8e547b38949f5387e4caaf2/users/1ad178ee25a74afcbd8572d985f0bbd5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:46.567898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.568695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.568695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.617529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] MFA Rules not processed for user `1ad178ee25a74afcbd8572d985f0bbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:46.632625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:46.657833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:46.833245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 890/1774] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:46.849084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:46.851273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:46.969123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30bcc-9d99-4ef0-841a-e04887df34bc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:46.973678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:46.974666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:46.975152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:46.975627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:46.977665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:47.056724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:47.058995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca87e-cc1e-4970-ae37-e9d4084df82d service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:47.072635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 885/1775] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:47.215091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:47.216636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:47.552738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c10ad-0a90-4236-b008-d7ed71e9c26f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:47.567145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:47.567913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:47.568227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:47.568506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:47.742873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:47.745325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f77c05-3da6-4116-9295-f3126e93c295 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:47.797942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 891/1776] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:48.510448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:48.511397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:48.512126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:48.513884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b694b0-e14d-4648-80c5-290065dc1fa7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:48.514520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b694b0-e14d-4648-80c5-290065dc1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:48.515086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b694b0-e14d-4648-80c5-290065dc1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:48.587148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] MFA Rules not processed for user `d5cca2e6407147fd99a92e8f0132d08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:48.590456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:48.597920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a9b694b0-e14d-4648-80c5-290065dc1fa7 None None] MFA Rules not processed for user `453b6e46935f44d09271e2720e4c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:48.599955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a9b694b0-e14d-4648-80c5-290065dc1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:48.756222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:48.799333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 892/1777] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:48.832415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:48.832705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:48.832981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:48.882486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 886/1778] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:48.920165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:48.921700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:49.147403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 893/1779] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:49.391593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:49.393063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:49.408949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:49.536023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:49.537484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:49.595692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57d95-a0f6-43f1-9a46-f4d8fbb3a26c None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:49.609868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:49.610582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:49.610865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:49.611135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:49.626971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:49.629857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:49.672883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 887/1780] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:40:49.683249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25bba4-3116-424d-bebb-f8b44cb8a8a5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:49.691965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:49.702581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:49.703155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:49.704255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] PATH_INFO: `/v3/projects/9b57c59b6f9f448bb0b62b83f1ec1bcf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:49.720510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b57c59b6f9f448bb0b62b83f1ec1bcf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:49.726604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:49.893178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b57c59b6f9f448bb0b62b83f1ec1bcf', 'request_id': 'req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:49.910751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b57c59b6f9f448bb0b62b83f1ec1bcf', 'request_id': 'req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:49.937418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b57c59b6f9f448bb0b62b83f1ec1bcf', 'request_id': 'req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:49.944513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:49.966416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] The token cache is being invalidate because project 9b57c59b6f9f448bb0b62b83f1ec1bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:49.967329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:49.967729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:49.972803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 894/1781] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:49 2022] DELETE /identity/v3/projects/9b57c59b6f9f448bb0b62b83f1ec1bcf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:49.977531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:50.014847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc2d00-5872-45e0-8193-8c6e0146da3b service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:50.398732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:50.399140 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:50.399262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:50.399478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] PATH_INFO: `/v3/users/0c5bbfedad56425db24ec89a3433ce26` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:50.416098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5bbfedad56425db24ec89a3433ce26)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:50.418100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:50.676196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5bbfedad56425db24ec89a3433ce26'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:50.677214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5bbfedad56425db24ec89a3433ce26'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:50.709199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5bbfedad56425db24ec89a3433ce26'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:50.756677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5bbfedad56425db24ec89a3433ce26'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:50.757863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fcd4cd8e-ee60-4fd2-bfd4-0b5b204d86e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5bbfedad56425db24ec89a3433ce26'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:50.774151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:50.809549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 888/1782] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:49 2022] DELETE /identity/v3/users/0c5bbfedad56425db24ec89a3433ce26 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:52.329275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:52.331539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:52.366921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e4a99-b1fc-4c0f-8931-a976f4f5a9cf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:52.584080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:52.584767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:52.585098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:52.585379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] PATH_INFO: `/v3/users/599bfe9d74334544a37fd27f7e2f3012` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:52.586591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599bfe9d74334544a37fd27f7e2f3012)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:52.588651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:52.704725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599bfe9d74334544a37fd27f7e2f3012'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:52.705998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599bfe9d74334544a37fd27f7e2f3012'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:52.755604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599bfe9d74334544a37fd27f7e2f3012'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:52.758031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599bfe9d74334544a37fd27f7e2f3012'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:52.778994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599bfe9d74334544a37fd27f7e2f3012'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:52.800412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 895/1783] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:52 2022] DELETE /identity/v3/users/599bfe9d74334544a37fd27f7e2f3012 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:52.805951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:52.806961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:52.807446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:52.879295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:52.880996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.039821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:53.041477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.075673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 889/1784] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:40:53.092467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0ec9e-b377-4eb1-9e14-fcec1cdb2a36 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:53.107501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:53.109116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.118059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:53.120668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:53.123038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:53.123321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] PATH_INFO: `/v3/projects/6c8ba52768624a26bc983bf13cb815ef` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:53.129788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8ba52768624a26bc983bf13cb815ef)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:53.139931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:53.392258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8ba52768624a26bc983bf13cb815ef', 'request_id': 'req-d8e25347-d5e6-4ac0-84fd-26c9010988d5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:53.440877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8566-b604-4408-b3d1-84b65bed5316 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:53.457030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8ba52768624a26bc983bf13cb815ef', 'request_id': 'req-d8e25347-d5e6-4ac0-84fd-26c9010988d5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:53.477344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8ba52768624a26bc983bf13cb815ef', 'request_id': 'req-d8e25347-d5e6-4ac0-84fd-26c9010988d5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:53.487523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:53.506718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] The token cache is being invalidate because project 6c8ba52768624a26bc983bf13cb815ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:53.507016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:53.508451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d8e25347-d5e6-4ac0-84fd-26c9010988d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:53.510131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 896/1785] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:53 2022] DELETE /identity/v3/projects/6c8ba52768624a26bc983bf13cb815ef => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:53.516821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d44ef-c1be-425f-9183-46f8e1e6d0ee None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:53.517291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d44ef-c1be-425f-9183-46f8e1e6d0ee None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:53.518058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d44ef-c1be-425f-9183-46f8e1e6d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:53.573433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ff7d44ef-c1be-425f-9183-46f8e1e6d0ee None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:53.577119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ff7d44ef-c1be-425f-9183-46f8e1e6d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.620553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:53.623719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:53.624683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:53.627857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:53.636093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.771614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 897/1786] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:53.773319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530599-2668-437e-ae65-2c910a4e0473 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:53.775201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530599-2668-437e-ae65-2c910a4e0473 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:53.775558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530599-2668-437e-ae65-2c910a4e0473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:53.847329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-14530599-2668-437e-ae65-2c910a4e0473 None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:53.850089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-14530599-2668-437e-ae65-2c910a4e0473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.882934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 898/1787] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Aug 18 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:53.884437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:53.886219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:53.886539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:53.950386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:53.951710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:53.978457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 899/1788] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:53.978457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:53.983272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:54.025240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2aba2-e299-4958-b164-4ce08cd3c1fc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.041905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.042550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.042865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.044735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.059490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.064437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.067600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.069255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.089656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 900/1789] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:54.090665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.094480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:54.122163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 890/1790] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1016 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:54.129103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.149644 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:54.161056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e2a8-dba4-46cf-8583-9783ea883f25 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.180804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609db36-aba7-44c7-ad9d-850db3199a1d service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.185578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.186282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.186567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.186844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.188774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.190025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:54.192458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.194533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.196993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.200575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:40:54.202197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.210373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.261376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 891/1791] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:40:54.261723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.291930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a1433-24a4-45d0-b7d9-a05068774d0e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.307977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.311884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.312573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.312852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.313126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.318478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.328309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.330670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.370776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 901/1792] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:54.439126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 892/1793] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:54 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:54.442580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.487151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84eb50-f631-4489-a16e-4b52b7eba9cf service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.572174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:54.769603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.771614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.772610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.772610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.773583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.775802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.833008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.833389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 902/1794] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:54 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:54.855938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22130-0825-4c08-bbaf-5115442002a2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.871953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.874033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.875680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.878625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:54.884587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:54.889507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:54.932957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 893/1795] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:54.936498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:54.970636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c88cf-4bbb-4cf3-9149-229039d7fda5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:54.993461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:54.994804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:54.995151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:54.997645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:55.001388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:55.003522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3735e5-3967-49bd-97e6-b4359bf67d10 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:55.061766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:55.063575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 903/1796] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:55.085648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8395fb-12d2-4651-87a0-9d3561b48761 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:55.111493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:55.115550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:55.118103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:55.118396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] PATH_INFO: `/v3/projects/ccf9d9acf83d4775b5d6e2effea5cb93/users/595340db227741c783cc310c539e70c1/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:55.183879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf9d9acf83d4775b5d6e2effea5cb93, user_id=595340db227741c783cc310c539e70c1, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:55.200699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:55.231390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 894/1797] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:55 2022] PUT /identity/v3/projects/ccf9d9acf83d4775b5d6e2effea5cb93/users/595340db227741c783cc310c539e70c1/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:55.243345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:55.243686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:55.243958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:55.305458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] MFA Rules not processed for user `595340db227741c783cc310c539e70c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:55.308687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:55.476719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 904/1798] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:55.477854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:55.732739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc868-fb4b-4799-94e6-1e41ea748ae4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:55.751290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:55.764019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:55.770011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:55.771277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:55.776503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:55.789349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:55.869206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 895/1799] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:40:55 2022] POST /identity/v3/projects => generated 369 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:55.870113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:55.890177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd467c8-e4c1-492e-b599-110d8f3d76d7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:56.099958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:56.101671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.102161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.102637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.103773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:56.106283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:56.148755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 905/1800] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:40:55 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:40:56.154350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:56.180844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45964-a6c4-4002-ba99-0b10cd65f56e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:56.199452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280345c-865c-48aa-a209-36546077896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:56.200105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280345c-865c-48aa-a209-36546077896d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.200406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280345c-865c-48aa-a209-36546077896d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.200719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280345c-865c-48aa-a209-36546077896d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.201372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280345c-865c-48aa-a209-36546077896d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:56.215703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280345c-865c-48aa-a209-36546077896d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:56.262312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:56.262981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 896/1801] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:56.296376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa64-b828-4a7f-9a0e-6e820a85cefb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:56.315625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:56.317663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.317969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.318892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] PATH_INFO: `/v3/projects/c39f8b7de81043a0b058344f81725bbe/users/5b6657c180ba4546a34605468770e1e7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.355486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:56.371215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39f8b7de81043a0b058344f81725bbe, user_id=5b6657c180ba4546a34605468770e1e7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:56.380168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:56.428458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 906/1802] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:56 2022] PUT /identity/v3/projects/c39f8b7de81043a0b058344f81725bbe/users/5b6657c180ba4546a34605468770e1e7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:56.433403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280345c-865c-48aa-a209-36546077896d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:56.450327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280345c-865c-48aa-a209-36546077896d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:56.594416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:56.595192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.595342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.595644 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.596285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:56.598207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370ef7d-a6e2-42b2-b696-610376ad8c8c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:56.623217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 897/1803] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:40:56.624324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:56.659179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f91a-5f7c-4daf-9014-cb819b687f6f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:56.703436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:56.704254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.716620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.719852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] PATH_INFO: `/v3/projects/c39f8b7de81043a0b058344f81725bbe/users/5b6657c180ba4546a34605468770e1e7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.724450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39f8b7de81043a0b058344f81725bbe, user_id=5b6657c180ba4546a34605468770e1e7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:56.750434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:56.833987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 907/1804] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:40:56 2022] PUT /identity/v3/projects/c39f8b7de81043a0b058344f81725bbe/users/5b6657c180ba4546a34605468770e1e7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:40:56.862918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:56.862918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:56.862918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:56.866041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:56.962670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] MFA Rules not processed for user `5b6657c180ba4546a34605468770e1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:56.967868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:57.268867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 898/1805] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:40:57.289642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:57.293285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:57.540452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbaf97-222c-42b0-a1e7-ae75b3a8054b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:57.558025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:57.558702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:57.558994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:57.567536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:57.599427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:57.601772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:57.656014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 908/1806] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:57.783088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:57.818506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b8ece-f410-4d7d-8ba8-6d85064fb116 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:57.823455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:57.824537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:57.824988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:57.825594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:57.949728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:57.953949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:57.986836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 899/1807] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:40:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:40:58.786876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:58.788483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:40:59.048960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570ac8d-28a4-44f0-b58d-69fd8808b4cb service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:59.056894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:59.058107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:59.059012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:59.059797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] PATH_INFO: `/v3/projects/229def8439694a7fb5fa36193e16b369` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:59.062110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] RBAC: Authorizing `identity:delete_project(project_id=229def8439694a7fb5fa36193e16b369)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:59.065635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:59.165599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229def8439694a7fb5fa36193e16b369', 'request_id': 'req-38c3c43b-eab7-4fd8-9ef9-29903fde432d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.176436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229def8439694a7fb5fa36193e16b369', 'request_id': 'req-38c3c43b-eab7-4fd8-9ef9-29903fde432d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.192153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229def8439694a7fb5fa36193e16b369', 'request_id': 'req-38c3c43b-eab7-4fd8-9ef9-29903fde432d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.224523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] The token cache is being invalidate because project 229def8439694a7fb5fa36193e16b369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:40:59.225373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.227362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38c3c43b-eab7-4fd8-9ef9-29903fde432d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.232775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 909/1808] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:40:58 2022] DELETE /identity/v3/projects/229def8439694a7fb5fa36193e16b369 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:59.237439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:40:59.259247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f7f3-ef31-4905-86d8-adc5d2e99ba0 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:40:59.480493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:40:59.481148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:59.481431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:59.481705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] PATH_INFO: `/v3/users/fb356757279a4771bb787388a012a0e8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:59.487542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb356757279a4771bb787388a012a0e8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:40:59.489251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:40:59.580449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:40:59.622231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb356757279a4771bb787388a012a0e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.622966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb356757279a4771bb787388a012a0e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.640363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb356757279a4771bb787388a012a0e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.659701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb356757279a4771bb787388a012a0e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.660486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-75222e95-3bc1-4d57-a05f-0d9278e47b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb356757279a4771bb787388a012a0e8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:40:59.703601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 900/1809] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:40:59 2022] DELETE /identity/v3/users/fb356757279a4771bb787388a012a0e8 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:40:59.832359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:59.832868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:59.833290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:59.835960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 910/1810] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:40:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:40:59.861088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf588-e41d-4b53-9ef4-4a2113852778 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:40:59.861383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf588-e41d-4b53-9ef4-4a2113852778 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:40:59.861694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdf588-e41d-4b53-9ef4-4a2113852778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:40:59.940193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7bbdf588-e41d-4b53-9ef4-4a2113852778 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:40:59.941979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7bbdf588-e41d-4b53-9ef4-4a2113852778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:00.154965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 901/1811] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:00.497512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:00.499436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:00.608578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e8ed1-e4e7-42d5-9121-0217e74127cd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:00.639028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:00.640151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:00.640309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:00.640593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:00.676343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:00.678329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:00.690353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:00.720490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 911/1812] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:00.986402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c456c-7f4b-45c6-a354-b6bc19622227 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:00.986950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c456c-7f4b-45c6-a354-b6bc19622227 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:00.986950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c456c-7f4b-45c6-a354-b6bc19622227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:01.043750 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-148c456c-7f4b-45c6-a354-b6bc19622227 None None] MFA Rules not processed for user `c19359f992c54313b7b1dfee4553f7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:01.045225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-148c456c-7f4b-45c6-a354-b6bc19622227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:01.256584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 902/1813] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:01.309142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:01.312943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:01.536107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8127e-379b-42bd-bf61-4d7797310d95 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:01.567298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:01.568155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:01.568507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:01.568901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] PATH_INFO: `/v3/users/eb4816ffb3cb47cc90cb4d6ddac0319d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:01.570759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4816ffb3cb47cc90cb4d6ddac0319d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:01.573072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:01.740349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4816ffb3cb47cc90cb4d6ddac0319d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:01.741574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4816ffb3cb47cc90cb4d6ddac0319d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:01.807626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4816ffb3cb47cc90cb4d6ddac0319d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:01.808762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4816ffb3cb47cc90cb4d6ddac0319d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:01.831875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c5da7c1-e28c-4a56-9334-4a59833a71bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4816ffb3cb47cc90cb4d6ddac0319d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:01.866895 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 912/1814] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:01 2022] DELETE /identity/v3/users/eb4816ffb3cb47cc90cb4d6ddac0319d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:01.867645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:01.867933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:01.868277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:01.903232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:01.904661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:02.060097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:02.160989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 903/1815] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:02.208484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4bc78-b90f-4e86-a507-3188f7f6bd0a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:02.209004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4bc78-b90f-4e86-a507-3188f7f6bd0a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:02.209391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4bc78-b90f-4e86-a507-3188f7f6bd0a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:02.211475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 913/1816] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:41:02.261296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:02.262726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:02.337891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:02.338489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:02.338686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:02.376902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:02.378559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:02.414153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73803db-1ec8-4b8b-a307-981197023299 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:02.428607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:02.428775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:02.429018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:02.429290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:02.469683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:02.471415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:02.494063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 914/1817] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:02.496360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 904/1818] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:03.114230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.117110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.141020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee32f-7496-4cdd-b4c7-c75acecdbafe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.146356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.147010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.147292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.147566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] PATH_INFO: `/v3/users/595340db227741c783cc310c539e70c1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.148968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595340db227741c783cc310c539e70c1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.151067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.164552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:03.297200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.301548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.332567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b8384-7611-4744-af8e-2e99bb85d30d service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.335498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595340db227741c783cc310c539e70c1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.338220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595340db227741c783cc310c539e70c1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.350327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.354744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.355168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.356758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] PATH_INFO: `/v3/projects/8f3471227ea34e4592e769e68ee04ceb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.360911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3471227ea34e4592e769e68ee04ceb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.366710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.386236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595340db227741c783cc310c539e70c1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.387620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595340db227741c783cc310c539e70c1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.400936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595340db227741c783cc310c539e70c1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.449019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 915/1819] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:03 2022] DELETE /identity/v3/users/595340db227741c783cc310c539e70c1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:03.449975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.452489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.454615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3471227ea34e4592e769e68ee04ceb', 'request_id': 'req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.470865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3471227ea34e4592e769e68ee04ceb', 'request_id': 'req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.486520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3471227ea34e4592e769e68ee04ceb', 'request_id': 'req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.503932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] The token cache is being invalidate because project 8f3471227ea34e4592e769e68ee04ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:03.504329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.505086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e66f4dd3-afbf-4ec8-a903-3b5e1250e2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:03.508283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 905/1820] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:03 2022] DELETE /identity/v3/projects/8f3471227ea34e4592e769e68ee04ceb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:03.510257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.511209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.511496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.533862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:03.535182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.554962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5382-f859-422e-a5b9-aa56d71f80c8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.563898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.564618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.565056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.565400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.567239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.584616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.588460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b711b0-685f-4109-8eab-1c2e63e7ba85 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.602964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 916/1821] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:03.606422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b0fd-5602-4abc-a243-10ebee5e5f24 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.606714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 906/1822] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:03.607719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b0fd-5602-4abc-a243-10ebee5e5f24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.610599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25b0fd-5602-4abc-a243-10ebee5e5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.616907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.618958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.632860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:03.646598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c25b0fd-5602-4abc-a243-10ebee5e5f24 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:03.649390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c25b0fd-5602-4abc-a243-10ebee5e5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.664205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 917/1823] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:03.669943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.670161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.672343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.706476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:03.707735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:03.722390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 918/1824] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:03.723834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.736205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2614d-8a74-4e23-bc49-8fa2ff71f910 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.742502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.743158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.743442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.743704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2374-0f8c-40af-9566-d2d73d80b443 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.744016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.745057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:03.745372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.747527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.757852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.759013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.759606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.760117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.768458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 919/1825] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:03.769465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.782487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa571911-4070-4377-8879-d91956c7c4aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.783643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.785403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.788207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.789274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.789560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.791229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.800932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 907/1826] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:03.802392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.804435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.844734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 920/1827] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:03 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:03.849156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:03.861697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c711-dc8f-4f04-80b9-7091b7e35f67 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:03.956800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:03.958394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:03.958942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:03.959598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:03.960386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:03.964640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:03.996123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 908/1828] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:03 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:03.998946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.011948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35fe08-7c79-4ee5-b75b-f849a8e90d16 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.017222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.018015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.018257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.018604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.020019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.022079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.050422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 921/1829] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:04.053405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.076124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657749-aa11-4469-95a8-edad98800db6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.086628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.087635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.087985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.088725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.089163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.091666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463e14-219b-4c64-a86e-2918e781986a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.112963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 909/1830] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:04.117348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.130164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6af6a-738b-42cc-a51f-d51d6a12e423 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.136590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.137439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.138772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.139189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] PATH_INFO: `/v3/projects/1f248d8bbc0d4c6d9faf9e786960c686/users/e0ad0e964c284865a6742f2c18672738/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.142577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:04.168209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f248d8bbc0d4c6d9faf9e786960c686, user_id=e0ad0e964c284865a6742f2c18672738, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.179036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.209884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 922/1831] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:04 2022] PUT /identity/v3/projects/1f248d8bbc0d4c6d9faf9e786960c686/users/e0ad0e964c284865a6742f2c18672738/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:04.214363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.214907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.215346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.255271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] MFA Rules not processed for user `e0ad0e964c284865a6742f2c18672738`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:04.255271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:04.348992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.352232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 910/1832] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:04.384792 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.386204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:04.441034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:04.455054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2116f6-6521-4da4-96dc-3c2412a59009 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.472874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.473643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.474201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.474624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.475456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.478717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.573691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 923/1833] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:04 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:04.580234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef25f9f-a01c-4982-950d-a32e9d39b540 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.582599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.669362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.670288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.671220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.671774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] PATH_INFO: `/v3/projects/f519d60bbf304124a0f3203bad426bc9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.675007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f519d60bbf304124a0f3203bad426bc9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.678141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.699029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a1ef8-1c41-49a8-8ec2-29b7ff3212d2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.704007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.704715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.704998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.705329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.705995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.708050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.742870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 924/1834] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:04 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:04.746344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.769848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fad52-dbc1-42b3-9551-8c14ef3fa3ab admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:04.776536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f519d60bbf304124a0f3203bad426bc9', 'request_id': 'req-193c7a24-135c-46bd-abf8-37cd53ce4d24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:04.786957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f519d60bbf304124a0f3203bad426bc9', 'request_id': 'req-193c7a24-135c-46bd-abf8-37cd53ce4d24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:04.799823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f519d60bbf304124a0f3203bad426bc9', 'request_id': 'req-193c7a24-135c-46bd-abf8-37cd53ce4d24'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:04.820761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] The token cache is being invalidate because project f519d60bbf304124a0f3203bad426bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:04.821452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:04.822478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:04.824854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 911/1835] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:04 2022] DELETE /identity/v3/projects/f519d60bbf304124a0f3203bad426bc9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:04.829481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.848741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:04.909657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:04.924023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:04.925737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:04.926282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:04.926560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:04.928970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:04.933119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:04.960698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 925/1836] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:04.974260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:04.979142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:04.996652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7e3fe-48ad-4b5e-9c61-de363f36d59c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.004225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.004802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:05.006275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.006812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.007245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] PATH_INFO: `/v3/projects/ccf9d9acf83d4775b5d6e2effea5cb93` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.008782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf9d9acf83d4775b5d6e2effea5cb93)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.011925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.020540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c7a24-135c-46bd-abf8-37cd53ce4d24 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.043009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.043676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.044034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.044586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] PATH_INFO: `/v3/users/1ad178ee25a74afcbd8572d985f0bbd5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.048383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad178ee25a74afcbd8572d985f0bbd5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.050834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.085596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf9d9acf83d4775b5d6e2effea5cb93', 'request_id': 'req-94e0f874-5eb0-43f6-ba0e-289774a25ae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.106319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf9d9acf83d4775b5d6e2effea5cb93', 'request_id': 'req-94e0f874-5eb0-43f6-ba0e-289774a25ae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.124653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf9d9acf83d4775b5d6e2effea5cb93', 'request_id': 'req-94e0f874-5eb0-43f6-ba0e-289774a25ae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.132875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad178ee25a74afcbd8572d985f0bbd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.134259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad178ee25a74afcbd8572d985f0bbd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.146927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] The token cache is being invalidate because project ccf9d9acf83d4775b5d6e2effea5cb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:05.147380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.148270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.150073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 926/1837] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:04 2022] DELETE /identity/v3/projects/ccf9d9acf83d4775b5d6e2effea5cb93 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:05.150903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:05.152374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:05.164947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad178ee25a74afcbd8572d985f0bbd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.177423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad178ee25a74afcbd8572d985f0bbd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.178430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad178ee25a74afcbd8572d985f0bbd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.230745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 912/1838] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:04 2022] DELETE /identity/v3/users/1ad178ee25a74afcbd8572d985f0bbd5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:05.231619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:05.237712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:05.273487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f874-5eb0-43f6-ba0e-289774a25ae7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.338732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395fcdb-c60e-43cf-bb9b-08921a42cbee admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.346767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.347584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.348871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.349222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] PATH_INFO: `/v3/users/5b6657c180ba4546a34605468770e1e7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.351270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6657c180ba4546a34605468770e1e7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.353472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.422455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6657c180ba4546a34605468770e1e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.423543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6657c180ba4546a34605468770e1e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.437849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6657c180ba4546a34605468770e1e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.459623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6657c180ba4546a34605468770e1e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.464436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6657c180ba4546a34605468770e1e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:05.491314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:05.515452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 913/1839] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:05 2022] DELETE /identity/v3/users/5b6657c180ba4546a34605468770e1e7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:05.522603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.526274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.526601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.526892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] PATH_INFO: `/v3/projects/22f65084ef8546df8ef52b3b04a5fedf/users/74f81ac0b9c54cca8d8c6db5bb15c45d/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.554948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f65084ef8546df8ef52b3b04a5fedf, user_id=74f81ac0b9c54cca8d8c6db5bb15c45d, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.559773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.590420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 927/1840] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:05 2022] PUT /identity/v3/projects/22f65084ef8546df8ef52b3b04a5fedf/users/74f81ac0b9c54cca8d8c6db5bb15c45d/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:05.594721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:05.597096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:05.708892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dff690-1c39-42f1-96d1-701768f2e57c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.806365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.807090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.807380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.807706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.808519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.810201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc0816-13a7-4808-bbfb-99c846155272 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.832130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 914/1841] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:05.836299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:05.852460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790cee0-94bf-4112-8432-617e21577ea1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:05.859768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:05.861259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.861761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.862246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] PATH_INFO: `/v3/projects/22f65084ef8546df8ef52b3b04a5fedf/users/74f81ac0b9c54cca8d8c6db5bb15c45d/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.866745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f65084ef8546df8ef52b3b04a5fedf, user_id=74f81ac0b9c54cca8d8c6db5bb15c45d, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:05.870352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:05.878185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:05.897564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 928/1842] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:05 2022] PUT /identity/v3/projects/22f65084ef8546df8ef52b3b04a5fedf/users/74f81ac0b9c54cca8d8c6db5bb15c45d/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:05.912693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:05.912693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:05.912693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:05.976327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] MFA Rules not processed for user `74f81ac0b9c54cca8d8c6db5bb15c45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:05.977409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:06.102365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 915/1843] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:06.110816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:06.112760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:06.229815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c96b3f-e9da-4640-a1c0-5838ff933d4f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:06.239747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:06.240940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:06.241437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:06.241857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:06.269453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:06.270936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464c5ba-305c-4364-891e-4148cda27246 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:06.296593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 929/1844] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:06.863951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:06.892438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:06.939764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e393a4a-2de2-438b-9159-c357ea1f4f6b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:06.946255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:06.946761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:06.947043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:06.947827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] PATH_INFO: `/v3/users/e0ad0e964c284865a6742f2c18672738` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:06.949158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ad0e964c284865a6742f2c18672738)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:06.951703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.022584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ad0e964c284865a6742f2c18672738'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.024018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ad0e964c284865a6742f2c18672738'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.049630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ad0e964c284865a6742f2c18672738'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.077050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ad0e964c284865a6742f2c18672738'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.082279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ad0e964c284865a6742f2c18672738'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.137311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 916/1845] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:06 2022] DELETE /identity/v3/users/e0ad0e964c284865a6742f2c18672738 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:07.138451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.139252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.139737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.159847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:07.161123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.236979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 930/1846] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:07.241938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.243413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.254199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.256898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.264520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c818c9-5d59-4744-8926-795df480d2e7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.271402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.272051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.272220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2bcf0-226c-4d4e-8cdf-7fd493451d4c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.272364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.272634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] PATH_INFO: `/v3/projects/c39f8b7de81043a0b058344f81725bbe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.273770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39f8b7de81043a0b058344f81725bbe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.278376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.279662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.280443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.280443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] PATH_INFO: `/v3/projects/25e6287be8e547b38949f5387e4caaf2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.281896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e6287be8e547b38949f5387e4caaf2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.283822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.290891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.360818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e6287be8e547b38949f5387e4caaf2', 'request_id': 'req-7d97f688-340c-4db6-a034-6b839670dae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.362010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39f8b7de81043a0b058344f81725bbe', 'request_id': 'req-afdea5c2-45fc-428e-9b4b-4f35cdea877d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.367916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39f8b7de81043a0b058344f81725bbe', 'request_id': 'req-afdea5c2-45fc-428e-9b4b-4f35cdea877d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.368864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e6287be8e547b38949f5387e4caaf2', 'request_id': 'req-7d97f688-340c-4db6-a034-6b839670dae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.375621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e6287be8e547b38949f5387e4caaf2', 'request_id': 'req-7d97f688-340c-4db6-a034-6b839670dae7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.376373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39f8b7de81043a0b058344f81725bbe', 'request_id': 'req-afdea5c2-45fc-428e-9b4b-4f35cdea877d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.389591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] The token cache is being invalidate because project c39f8b7de81043a0b058344f81725bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:07.389887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.391183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.391501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] The token cache is being invalidate because project 25e6287be8e547b38949f5387e4caaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:07.391730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.392963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 917/1847] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:07 2022] DELETE /identity/v3/projects/c39f8b7de81043a0b058344f81725bbe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:07.393648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.394983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.395159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d97f688-340c-4db6-a034-6b839670dae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:07.396950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 931/1848] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:07 2022] DELETE /identity/v3/projects/25e6287be8e547b38949f5387e4caaf2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:07.402295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611717c8-f9c8-4539-ad3d-a8a6131ee1e5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.402586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611717c8-f9c8-4539-ad3d-a8a6131ee1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.402952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611717c8-f9c8-4539-ad3d-a8a6131ee1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.427663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-611717c8-f9c8-4539-ad3d-a8a6131ee1e5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:07.428051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:07.429500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-611717c8-f9c8-4539-ad3d-a8a6131ee1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.445654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:07.465033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea5c2-45fc-428e-9b4b-4f35cdea877d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.504324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 932/1849] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:07.504324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95734-e3ad-447b-98b4-67700cda8393 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.504324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95734-e3ad-447b-98b4-67700cda8393 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.504324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d95734-e3ad-447b-98b4-67700cda8393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.523376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f8d95734-e3ad-447b-98b4-67700cda8393 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:07.524606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f8d95734-e3ad-447b-98b4-67700cda8393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.525452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.526065 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.526345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.526620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.528331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.532967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 933/1850] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:07.534140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.534424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.534693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.545577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.547519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af0102-6db7-4042-b584-1064346872c8 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.554781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:07.554781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.558441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 918/1851] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:07.562023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.562482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.562977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.564474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 934/1852] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:07.568154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.579924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec740e-1a7c-4d90-a208-7bceacc25fef None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.585079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.585623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.585902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.586226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.586911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:07.587214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.588858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.589957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:07.591753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.601437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 935/1853] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:41:07.604290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 919/1854] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:07.605206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.605338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.615684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dcc8-bb5a-49c2-833f-d9beda8364f6 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.615858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d455e-5d5d-4b49-8b59-b1ec5937b853 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.620375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.620553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.620975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.621137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.621237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.621905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.622052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.622144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:07.622315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.622465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.623008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.624089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.624930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.639639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 936/1855] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:41:07.644117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.656560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb55e16-bff9-45fc-9b92-1862fa312731 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.664273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.665143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.665557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.665746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 920/1856] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:07.666132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.667188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.669349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.669907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.701167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 937/1857] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:07.705689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.756479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ecf7d-5b00-47dc-a35c-9f717c415944 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.784179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7eee-9c7c-4062-afd1-99b5bb00ac4e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.788859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.789475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.789805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.790073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.790730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.792857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.817850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 938/1858] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:07.821866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.832830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4c93-86d5-4fbf-a1c4-5e4fe0f6d1b7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.834284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.834922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.835254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.835465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.836103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.837927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.838230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.838541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.838823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.839701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.840515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.842217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.850965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:07.857251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 939/1859] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:07.861368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.865665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 921/1860] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:07 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:07.869247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.872357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83629d9a-db9a-49d8-86f3-03354e20e10e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.876899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.877898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.878224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.878503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.879260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.880603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c111f-0bb8-4ce5-97f2-db7f0458a506 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.881018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.886636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.887263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.887547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.887818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.888646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.890279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.891101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 940/1861] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:07.895204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.906627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 922/1862] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:07.906775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3860de-4939-46c1-9c32-206393e203cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.910961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.912046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.912936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.913225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.913611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] PATH_INFO: `/v3/projects/376cb3909edb4da1825cc4370109ad2d/users/05b3f5e5d78446c1ac13cb5b9b3f747c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.928334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de315-bfb9-4c77-88c0-99577f4e0af8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:07.930435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376cb3909edb4da1825cc4370109ad2d, user_id=05b3f5e5d78446c1ac13cb5b9b3f747c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.932800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:07.933170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.934181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:07.934917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:07.935188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:07.935832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:07.937989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:07.949002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 941/1863] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:07 2022] PUT /identity/v3/projects/376cb3909edb4da1825cc4370109ad2d/users/05b3f5e5d78446c1ac13cb5b9b3f747c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:07.949602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.950804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 923/1864] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:07.954894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:07.960023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:07.965546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:07.966679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233bea-3cc6-4f85-b813-8045044ae7c8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.026215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.026848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9b0ef-f6dc-4d23-9e69-f7c5f77217c0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.027031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.027352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.027632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] PATH_INFO: `/v3/projects/e7f0240e07bc419982229d4c9af70f8d/users/80e0355112174bf5a7e4b95795ea2071/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.032700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.033432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.033707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.034001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] PATH_INFO: `/v3/projects/1f248d8bbc0d4c6d9faf9e786960c686` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.035529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f248d8bbc0d4c6d9faf9e786960c686)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.037506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.048469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f0240e07bc419982229d4c9af70f8d, user_id=80e0355112174bf5a7e4b95795ea2071, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.051433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406831ce-1502-47e5-b3e8-5d27e88f6117 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.066574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 924/1865] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:07 2022] PUT /identity/v3/projects/e7f0240e07bc419982229d4c9af70f8d/users/80e0355112174bf5a7e4b95795ea2071/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:08.068170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.068490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.068794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.110417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] MFA Rules not processed for user `05b3f5e5d78446c1ac13cb5b9b3f747c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:08.111248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f248d8bbc0d4c6d9faf9e786960c686', 'request_id': 'req-3b61d1df-0298-4961-b4e3-17a9e22d4cae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.112037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.124938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f248d8bbc0d4c6d9faf9e786960c686', 'request_id': 'req-3b61d1df-0298-4961-b4e3-17a9e22d4cae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.143377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f248d8bbc0d4c6d9faf9e786960c686', 'request_id': 'req-3b61d1df-0298-4961-b4e3-17a9e22d4cae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.162042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] The token cache is being invalidate because project 1f248d8bbc0d4c6d9faf9e786960c686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:08.162497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.163645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b61d1df-0298-4961-b4e3-17a9e22d4cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.165341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 942/1866] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:07 2022] DELETE /identity/v3/projects/1f248d8bbc0d4c6d9faf9e786960c686 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:08.166377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.166772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.167141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.206869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] MFA Rules not processed for user `80e0355112174bf5a7e4b95795ea2071`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:08.208345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.264186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 925/1867] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:08.265861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.270502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.353540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 943/1868] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:08.354833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.356490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.409784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:08.445608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:08.475986 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fbb50-adb6-44b4-8319-6ca47cc69043 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.481575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bd7fb-beb3-40ce-9f43-0d6c0502b478 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.489539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.491010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.491296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.491568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.492971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.493649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.493891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.494158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] PATH_INFO: `/v3/users/74f81ac0b9c54cca8d8c6db5bb15c45d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.496812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f81ac0b9c54cca8d8c6db5bb15c45d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.499439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.511784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.524592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.555336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 944/1869] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:08.566527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.571758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.598556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f81ac0b9c54cca8d8c6db5bb15c45d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.599602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f81ac0b9c54cca8d8c6db5bb15c45d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.600044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24644d2-b2a3-4b83-801f-f4753f11473e service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.613488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f81ac0b9c54cca8d8c6db5bb15c45d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.614743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.615538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.615910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.616357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.617058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.619260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.627190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f81ac0b9c54cca8d8c6db5bb15c45d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.628732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f81ac0b9c54cca8d8c6db5bb15c45d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.660675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 945/1871] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:08 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:08.660675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.661637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 926/1871] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:08 2022] DELETE /identity/v3/users/74f81ac0b9c54cca8d8c6db5bb15c45d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:08.662149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.663060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.665278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.767511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd043a-7a04-4923-80e2-555ca094085b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.782225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.783117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.783496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.783866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] PATH_INFO: `/v3/users/05b3f5e5d78446c1ac13cb5b9b3f747c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.786924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b3f5e5d78446c1ac13cb5b9b3f747c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.789349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.819387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13db6-7d4a-42fe-a175-a25310b13975 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.835241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.836427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.836937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.837430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.838333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.840881 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.889148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 927/1872] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:08 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:08.892280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.893194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b3f5e5d78446c1ac13cb5b9b3f747c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.896375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b3f5e5d78446c1ac13cb5b9b3f747c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.917865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440101b-0c88-4300-a721-5b4ce6926126 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.929760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b3f5e5d78446c1ac13cb5b9b3f747c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.931192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:08.931904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b3f5e5d78446c1ac13cb5b9b3f747c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.934715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.935355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.935827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:08.936720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:08.938880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:08.949721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08127b2f-3125-4fca-985c-8b82b61d9fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b3f5e5d78446c1ac13cb5b9b3f747c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:08.958575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 928/1873] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:08.963495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:08.966729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:08.981939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 946/1874] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:08 2022] DELETE /identity/v3/users/05b3f5e5d78446c1ac13cb5b9b3f747c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:08.985040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58afcea-33f9-4bac-bf2e-9d342004bc83 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:08.987171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:08.987470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:08.987751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.011415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:09.012853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:09.034015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:09.084897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:09.117063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.117705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.117976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.118289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] PATH_INFO: `/v3/projects/e08610232d024531ba549ea839f2ce7d/users/1e81338cdb604f229fa915282ad4879d/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.136467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08610232d024531ba549ea839f2ce7d, user_id=1e81338cdb604f229fa915282ad4879d, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.138259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 947/1875] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:09.139221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.156337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 929/1876] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:08 2022] PUT /identity/v3/projects/e08610232d024531ba549ea839f2ce7d/users/1e81338cdb604f229fa915282ad4879d/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:09.160712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:09.172995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:09.181198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f107aa6-5134-41d6-8286-2a67a95d663c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:09.189231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:09.276534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8f95-f4a7-48e0-9e0d-040796143dc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:09.281686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.282427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.282902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.283277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.328990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.329879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.331573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.332774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.334305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.336380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.362996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 948/1877] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:09.364087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:09.376589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28ca8-af4a-4f09-b8dc-e8758a0970fc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:09.381519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.382199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.382481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.382758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] PATH_INFO: `/v3/projects/e08610232d024531ba549ea839f2ce7d/users/1e81338cdb604f229fa915282ad4879d/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.385200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08610232d024531ba549ea839f2ce7d, user_id=1e81338cdb604f229fa915282ad4879d, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.388181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a48e6-e7af-4855-95b8-ff838ee14e7d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.394332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.396934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.412105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 949/1878] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:09 2022] PUT /identity/v3/projects/e08610232d024531ba549ea839f2ce7d/users/1e81338cdb604f229fa915282ad4879d/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:09.419710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 930/1879] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:09.420999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.421325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.421603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.457905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] MFA Rules not processed for user `1e81338cdb604f229fa915282ad4879d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:09.459621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:09.543118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 950/1880] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:09.559588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:09.561119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:09.570096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:09.580833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:09.657055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:09.660706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24242d78-cafc-450d-9493-0ad6df05fe12 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:09.695494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:09.696718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc44a4-a4c1-4152-b58b-af45dd69d3f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:09.702989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.703810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.704707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.705265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] PATH_INFO: `/v3/projects/22f65084ef8546df8ef52b3b04a5fedf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.707497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f65084ef8546df8ef52b3b04a5fedf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.710192 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.737333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:09.738095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.738495 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.738871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.756388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:09.758413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e39c24-ba3b-481b-8d8d-dfee44b3e351 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:09.782014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 931/1881] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:09.810031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f65084ef8546df8ef52b3b04a5fedf', 'request_id': 'req-5f115016-84b7-4017-9493-1e978670d9ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:09.818478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f65084ef8546df8ef52b3b04a5fedf', 'request_id': 'req-5f115016-84b7-4017-9493-1e978670d9ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:09.827476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f65084ef8546df8ef52b3b04a5fedf', 'request_id': 'req-5f115016-84b7-4017-9493-1e978670d9ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:09.847373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] The token cache is being invalidate because project 22f65084ef8546df8ef52b3b04a5fedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:09.847920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:09.848672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f115016-84b7-4017-9493-1e978670d9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:09.851626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 951/1882] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:09 2022] DELETE /identity/v3/projects/22f65084ef8546df8ef52b3b04a5fedf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:09.856235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:09.856661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:09.857015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:09.886373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:09.887712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:10.026789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 932/1883] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:10.031498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.031498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.031498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.075121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:10.076551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:10.106243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 952/1884] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:10.110548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.123412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37539e-5345-4df5-90f6-8a22805b5ef3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.136889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.137678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.138053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.138441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.139351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:10.139756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.145455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.176521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 933/1885] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:10.181249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.191770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cd2d1-1fd1-47f4-ad44-4716523da93f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.199933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.201120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.201521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.202030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.204095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.207762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.275521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 953/1886] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:10 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:10.279448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.292894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c1179-b202-4403-aab1-a9074cfe2483 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.315646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.317809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:10.417043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.418761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.420516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.420890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.423295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.427627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.450966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be5a18-6801-4b7d-be2c-ed22e4635fee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.466120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81338cdb604f229fa915282ad4879d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08610232d024531ba549ea839f2ce7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.467151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.467759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.468372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.470889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:10.471761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.473707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.478528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 934/1887] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:10 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:10.480008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.505107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963cc2-87f2-481f-adeb-6720257a9cc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.505478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 954/1888] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:10.509184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.518047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.518678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.518958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.519234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.519902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.522888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb66-67c9-4d1b-9d7f-3a91dcd8650b tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.525480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.528824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81338cdb604f229fa915282ad4879d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08610232d024531ba549ea839f2ce7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.529746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.530259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.530888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.531905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.534222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.544254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 935/1889] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:10.548527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.573339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53108-3d50-47e9-9efe-9ff27a70012a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.580169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.580923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.582277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.582661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.583493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.585492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.593749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 955/1890] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:10 2022] POST /identity/v3/projects => generated 354 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:10.595323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.601420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:10.610300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 936/1891] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:10.611730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:10.627869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f772828-6d9e-4ec9-b0a9-32948485c8d8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.697820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:10.729981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1d46-c8f3-40d8-9e19-c89733561361 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:10.735643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81338cdb604f229fa915282ad4879d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08610232d024531ba549ea839f2ce7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.737063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.737350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.737629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.738346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:10.738657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.740507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf7e7-e88b-4997-8710-f60894222d59 tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.755598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 956/1892] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:10.775372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:10.797238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdaa12-e0a7-431c-8892-280f3f476e76 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.797752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdaa12-e0a7-431c-8892-280f3f476e76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.798119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdaa12-e0a7-431c-8892-280f3f476e76 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.799584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 957/1893] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:41:10.806878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.807276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.807560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] PATH_INFO: `/v3/projects/0b56da6fd0e543a9b77e4a47ac9edd9c/users/98ae81095e784f3db8ac91d13dc7be6d/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.826884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110100-7ce2-486b-9473-921b8b115619 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:10.827266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110100-7ce2-486b-9473-921b8b115619 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:10.827687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110100-7ce2-486b-9473-921b8b115619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:10.856818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-17110100-7ce2-486b-9473-921b8b115619 None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:10.858186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17110100-7ce2-486b-9473-921b8b115619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:10.865509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b56da6fd0e543a9b77e4a47ac9edd9c, user_id=98ae81095e784f3db8ac91d13dc7be6d, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:10.871773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:10.917808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 937/1894] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:10 2022] PUT /identity/v3/projects/0b56da6fd0e543a9b77e4a47ac9edd9c/users/98ae81095e784f3db8ac91d13dc7be6d/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:10.932808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.020464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561f6c0-f682-43f9-9d56-528414ba4297 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.027588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81338cdb604f229fa915282ad4879d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08610232d024531ba549ea839f2ce7d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.028276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.028657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.028832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] PATH_INFO: `/v3/projects/96380c43f2754ae29a3013a1be280e0b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.031408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96380c43f2754ae29a3013a1be280e0b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.034414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.098352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 958/1895] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:11.099863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.100287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.100660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.105879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96380c43f2754ae29a3013a1be280e0b', 'request_id': 'req-7c871051-a9dd-4589-a668-6b19e100f4ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.114875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96380c43f2754ae29a3013a1be280e0b', 'request_id': 'req-7c871051-a9dd-4589-a668-6b19e100f4ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.124863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96380c43f2754ae29a3013a1be280e0b', 'request_id': 'req-7c871051-a9dd-4589-a668-6b19e100f4ae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.141185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] The token cache is being invalidate because project 96380c43f2754ae29a3013a1be280e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:11.141482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.142358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.157612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 938/1896] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:10 2022] DELETE /identity/v3/projects/96380c43f2754ae29a3013a1be280e0b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:11.165482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] MFA Rules not processed for user `98ae81095e784f3db8ac91d13dc7be6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:11.166838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.271510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 959/1897] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:11.272152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.273058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.322286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.323913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.352977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:11.405292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:11.447808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871051-a9dd-4589-a668-6b19e100f4ae tempest-VolumeQuotaClassesTest-892612836 tempest-VolumeQuotaClassesTest-892612836-project-admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.460239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.460902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.461188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.461513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.462221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.464328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.475761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f8c3-4dd5-4ee1-a0df-08f074d24b73 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.493410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.494543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.494820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.495878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.500781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.523376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.525526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.525774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 939/1898] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:11 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:11.526866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.528607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.550825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 960/1899] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:11.552212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.569575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fccff-8bbf-4ccc-9f4a-c79412bebb15 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.680889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5938b0-d4e9-42dd-94c5-8d4a10710e1f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.688398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.689025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.689492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.689761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.690425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.692561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.695718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.696526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.696812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.697086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] PATH_INFO: `/v3/projects/376cb3909edb4da1825cc4370109ad2d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.707600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376cb3909edb4da1825cc4370109ad2d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.710836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.735107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 961/1900] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:11 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:11.735894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.740314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.768165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fea51-b3ba-4f47-abd9-bfead3ce49cf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.780285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.781742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.782021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.782291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] PATH_INFO: `/v3/users/80e0355112174bf5a7e4b95795ea2071` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.785149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e0355112174bf5a7e4b95795ea2071)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.789039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.812134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376cb3909edb4da1825cc4370109ad2d', 'request_id': 'req-73707c68-d7ef-4cc3-b845-e154d7e16c95'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.825626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376cb3909edb4da1825cc4370109ad2d', 'request_id': 'req-73707c68-d7ef-4cc3-b845-e154d7e16c95'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.838622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376cb3909edb4da1825cc4370109ad2d', 'request_id': 'req-73707c68-d7ef-4cc3-b845-e154d7e16c95'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.860151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] The token cache is being invalidate because project 376cb3909edb4da1825cc4370109ad2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:11.860473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.861336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.863168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 940/1901] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:11 2022] DELETE /identity/v3/projects/376cb3909edb4da1825cc4370109ad2d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:11.863955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:11.865865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:11.896675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e0355112174bf5a7e4b95795ea2071'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.897433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e0355112174bf5a7e4b95795ea2071'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.914455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e0355112174bf5a7e4b95795ea2071'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.915789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e0355112174bf5a7e4b95795ea2071'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.926143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c4a74000-47b1-48a8-b802-bb13b9cae3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e0355112174bf5a7e4b95795ea2071'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:11.964460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:11.973958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73707c68-d7ef-4cc3-b845-e154d7e16c95 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:11.982489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:11.983691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.986818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.986818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:11.986818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:11.987539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 962/1902] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:11 2022] DELETE /identity/v3/users/80e0355112174bf5a7e4b95795ea2071 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:11.987715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9df3d-6647-4170-a32f-f3231a9d4ecd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:11.989247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:11.991095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:11.997621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.008910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 941/1903] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:12.008910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc413b-9978-4cc9-9239-f2291df83ac1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.008910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc413b-9978-4cc9-9239-f2291df83ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.008910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc413b-9978-4cc9-9239-f2291df83ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.028023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:12.045251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:12.046559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.055308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-eacc413b-9978-4cc9-9239-f2291df83ac1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:12.069948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eacc413b-9978-4cc9-9239-f2291df83ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.163891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 963/1904] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:12.164809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.172081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.185922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 942/1905] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:12.190982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.191273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.191553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.208743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf22ef-b6f3-4e04-993b-78fe103b9310 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.225309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.226003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.226532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.226818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] PATH_INFO: `/v3/projects/ab05a7f181da4687a6892403f8ea1ccc/users/dd89cbb9f611403ab2085679f0c659e7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.246457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:12.247830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.263495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab05a7f181da4687a6892403f8ea1ccc, user_id=dd89cbb9f611403ab2085679f0c659e7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.267067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.268785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 943/1906] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:12.269856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.271293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.289610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 964/1907] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:12 2022] PUT /identity/v3/projects/ab05a7f181da4687a6892403f8ea1ccc/users/dd89cbb9f611403ab2085679f0c659e7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:12.289610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.349990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94378f8b-d2ff-4913-b88c-dcba03548949 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.443372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b35f-aa9f-41b2-aba7-5ff3f36d1a50 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.455138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.459402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.459800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.460288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.461152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:12.461974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.465792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.489660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 965/1908] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:12.490743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.512330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94381-20e2-4250-9226-4c253320b098 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.514161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.515509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.516007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.516607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.523273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.524020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.524340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.525441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.526212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.527942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.531491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.533698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.543770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 966/1909] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:12.544913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.547682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 944/1910] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:12.548716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.560529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2383889-c50b-4654-9d7d-73a59d863c9a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.561005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4803c5-43ec-4ff1-a3d2-33185da18fba service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.566010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.566620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.567484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.567484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.567750 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.568502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.569361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.569688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.570012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.570464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] PATH_INFO: `/v3/projects/ab05a7f181da4687a6892403f8ea1ccc/users/dd89cbb9f611403ab2085679f0c659e7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.573293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab05a7f181da4687a6892403f8ea1ccc, user_id=dd89cbb9f611403ab2085679f0c659e7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.576525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a1cab-987d-4392-b53c-ef655ddbff83 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.588472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 945/1911] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:12 2022] PUT /identity/v3/projects/ab05a7f181da4687a6892403f8ea1ccc/users/dd89cbb9f611403ab2085679f0c659e7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:12.600375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.600672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.600954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.604110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 967/1912] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:12.605772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.631515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] MFA Rules not processed for user `dd89cbb9f611403ab2085679f0c659e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:12.633414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.665552 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:12.681301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:12.687981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e22212-720f-42b3-a4c3-cc1d02412f74 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.694446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.695268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.695890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.696200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.696827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.699148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.737554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 968/1913] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:12.741187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.753027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de19e57-3aec-49f3-8be2-95cc6c958ffc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.757957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 946/1914] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:12.758937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.759625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.759911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.760239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.760890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.763485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.770102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.771511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:12.778719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 969/1915] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:12.781364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.792259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d5ab-2ef0-4778-902d-a700a93e9e06 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.798053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.799074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.799382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.799730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.800403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.802356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.814559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 970/1916] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:12.818799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:12.831879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9a80-e5b6-40b1-b37e-dec715804dee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.837344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.837658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.837940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.838468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] PATH_INFO: `/v3/projects/f342fc06e9fc4ec2b26f67abcdaa4425/users/68055a8f4448428a87c21b4cee8dd8cd/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.841106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af491d4-5624-4198-ae44-ec5715008ac1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:12.845599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:12.846215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.846501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.847004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.859229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.861038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4692741-2f42-4334-a36e-db8da4dab550 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.871193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 947/1917] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:12.883112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f342fc06e9fc4ec2b26f67abcdaa4425, user_id=68055a8f4448428a87c21b4cee8dd8cd, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:12.886110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:12.905132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 971/1918] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:12 2022] PUT /identity/v3/projects/f342fc06e9fc4ec2b26f67abcdaa4425/users/68055a8f4448428a87c21b4cee8dd8cd/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:12.915635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:12.915926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:12.916278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:12.958913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] MFA Rules not processed for user `68055a8f4448428a87c21b4cee8dd8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:12.960179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:13.000130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:13.050662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 948/1919] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:13.063845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:13.066184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:13.126286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddf6e3-b9eb-4393-a6b0-a8907f68b393 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:13.131058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:13.131794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:13.132097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:13.132377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:13.134581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:13.150614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaef94-23a0-4393-afbc-a45a8f29ba04 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:13.155108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:13.156141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:13.156518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:13.156883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:13.166320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:13.171650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:13.173390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:13.198473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 949/1920] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:13.240948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:13.242820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:13.254533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 972/1921] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:13.858194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:13.860360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:13.932086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df39e5a-d7ad-45b8-ac5e-8d1042e4f885 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:13.936654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:13.937309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:13.937589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:13.937885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] PATH_INFO: `/v3/projects/e7f0240e07bc419982229d4c9af70f8d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:13.938977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f0240e07bc419982229d4c9af70f8d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:13.940937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:13.988070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f0240e07bc419982229d4c9af70f8d', 'request_id': 'req-aa303729-dddb-4406-ba47-14e2e2839ac8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:13.993649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f0240e07bc419982229d4c9af70f8d', 'request_id': 'req-aa303729-dddb-4406-ba47-14e2e2839ac8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.001136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f0240e07bc419982229d4c9af70f8d', 'request_id': 'req-aa303729-dddb-4406-ba47-14e2e2839ac8'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.012832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] The token cache is being invalidate because project e7f0240e07bc419982229d4c9af70f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:14.013124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.013794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.015341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 950/1922] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:13 2022] DELETE /identity/v3/projects/e7f0240e07bc419982229d4c9af70f8d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:14.019323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:14.030047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508ba6-5cc8-4ead-91b1-1a8d516ff38e service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:14.078545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:14.103812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:14.104664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:14.105188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:14.105635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] PATH_INFO: `/v3/users/1e81338cdb604f229fa915282ad4879d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:14.107939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e81338cdb604f229fa915282ad4879d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:14.110569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:14.170484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e81338cdb604f229fa915282ad4879d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.171212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e81338cdb604f229fa915282ad4879d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.191012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e81338cdb604f229fa915282ad4879d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.191738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e81338cdb604f229fa915282ad4879d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.203425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a8f0cc9-17eb-430e-897b-27f3e3d6a344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e81338cdb604f229fa915282ad4879d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.221539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 973/1923] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:14 2022] DELETE /identity/v3/users/1e81338cdb604f229fa915282ad4879d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:14.713381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:14.725534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:14.750244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303729-dddb-4406-ba47-14e2e2839ac8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:14.812855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:14.813493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:14.813945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:14.814129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] PATH_INFO: `/v3/projects/e08610232d024531ba549ea839f2ce7d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:14.815568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08610232d024531ba549ea839f2ce7d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:14.817528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:14.873398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:14.922831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08610232d024531ba549ea839f2ce7d', 'request_id': 'req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.938485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08610232d024531ba549ea839f2ce7d', 'request_id': 'req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.959244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08610232d024531ba549ea839f2ce7d', 'request_id': 'req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.989428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] The token cache is being invalidate because project e08610232d024531ba549ea839f2ce7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:14.989747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.990598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-27be0bfc-3f22-4b5a-8b43-6e4593629ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:14.995295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 951/1924] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:14 2022] DELETE /identity/v3/projects/e08610232d024531ba549ea839f2ce7d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:14.997029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:14.997515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:14.997847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.056557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:15.058068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:15.170450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 974/1925] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:15.178592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.179343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.180202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.204765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:15.206483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:15.220967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 952/1926] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:15.225417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.239643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7da75-ac1c-462f-b95e-2cda77f8be7d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.245557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.247082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.247659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.248179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.248937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:15.249351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.251235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.277559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 975/1927] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:15.285173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.299607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8383275-4900-4877-a849-5c560d9ed4b0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.305063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.305779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.306126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.306469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.307198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.309253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.348540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 953/1928] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:15.352457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.369019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf958ba-de32-41b7-a0a4-1d4710c13c59 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.458707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:15.476464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.477086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.477370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.477640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.478469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.480577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.508726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 976/1929] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:15.512548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.524686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9027f7-b8cd-47f3-adfd-9f5fc38f5def admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.531263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.531967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.532354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.532697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.533412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.535087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.546045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 954/1930] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:15.550363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.561340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a633c7-6f0e-4970-b5b8-5a294eec8f5a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.566203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.566814 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.567094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.567365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.568173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.569641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768353ad-5e95-4f86-8926-7c5ce09146b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.581376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 977/1931] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:15.587279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.597747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9ed94-51bd-464e-8048-b07720648929 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.602285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.602924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.603204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.603476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] PATH_INFO: `/v3/projects/6aa00cf0ff7a47dd8afc5439c963f488/users/518c3a9e9d3046238507554f223f9d8b/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.617784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa00cf0ff7a47dd8afc5439c963f488, user_id=518c3a9e9d3046238507554f223f9d8b, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.620470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.633365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 955/1932] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:15 2022] PUT /identity/v3/projects/6aa00cf0ff7a47dd8afc5439c963f488/users/518c3a9e9d3046238507554f223f9d8b/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:15.643858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.644172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.644475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.671687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] MFA Rules not processed for user `518c3a9e9d3046238507554f223f9d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:15.672919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:15.748341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 978/1933] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:15.753250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.820758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664bb2-c593-48f6-9146-a49bb0fb3ac5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.825995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.826675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.827018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.827963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.829067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.830648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.864104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 956/1934] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:15.865587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:15.877041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421c52-fefa-44fb-a59a-4d0d7db0f132 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:15.951305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:15.952076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:15.952966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:15.953256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:15.954916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:15.958265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:15.996624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 979/1935] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:15 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:15.999797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.019200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66c71-15a5-4916-ad83-e673030b0b8d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.024432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.025153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.025538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.026048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.026786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.028583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.039691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 957/1936] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:16.043922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.055132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2b2-8195-456e-bc9a-da0b9bf97d6e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.060001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.061260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.061549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.062603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] PATH_INFO: `/v3/projects/74a09d2f92ad4566924643e646e44a8d/users/1a97aad16ae34d7db0cdc4f2bf7b50c4/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.084341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a09d2f92ad4566924643e646e44a8d, user_id=1a97aad16ae34d7db0cdc4f2bf7b50c4, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.087045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.116154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 980/1937] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:16 2022] PUT /identity/v3/projects/74a09d2f92ad4566924643e646e44a8d/users/1a97aad16ae34d7db0cdc4f2bf7b50c4/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:16.120893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.137342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75266c-b159-4dcd-bc66-9bac05253288 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.206247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:16.306334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.306862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.307144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.307413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.308209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.310008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeddc4-cde6-4c75-a72c-9563b699488d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.329943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 958/1938] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:16.334159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.349223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052a1b5-6bd9-45fc-ab5c-0e77e4733c62 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.383145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.386806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.389178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.396313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] PATH_INFO: `/v3/projects/74a09d2f92ad4566924643e646e44a8d/users/1a97aad16ae34d7db0cdc4f2bf7b50c4/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.398590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a09d2f92ad4566924643e646e44a8d, user_id=1a97aad16ae34d7db0cdc4f2bf7b50c4, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.401504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.455878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 981/1939] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:16 2022] PUT /identity/v3/projects/74a09d2f92ad4566924643e646e44a8d/users/1a97aad16ae34d7db0cdc4f2bf7b50c4/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:16.467224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.467659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.468162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.544899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] MFA Rules not processed for user `1a97aad16ae34d7db0cdc4f2bf7b50c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:16.547458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:16.591251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.593652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:16.622667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:16.763727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 959/1940] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:16.772346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695e8c1-2983-4c7e-8f79-c5950c27a98c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.778706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.779428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.779781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.780156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] PATH_INFO: `/v3/users/98ae81095e784f3db8ac91d13dc7be6d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.781918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ae81095e784f3db8ac91d13dc7be6d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.783924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.790767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.792430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:16.845922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ae81095e784f3db8ac91d13dc7be6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:16.845922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ae81095e784f3db8ac91d13dc7be6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:16.859773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ae81095e784f3db8ac91d13dc7be6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:16.860801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ae81095e784f3db8ac91d13dc7be6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:16.869717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b06cee0-7dd7-4227-b75e-b088a378edd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ae81095e784f3db8ac91d13dc7be6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:16.873952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da59d-e486-4b13-87e4-d9d51aa64668 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:16.881661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:16.882115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.882400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.882674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.884508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:16.888102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 982/1941] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:16 2022] DELETE /identity/v3/users/98ae81095e784f3db8ac91d13dc7be6d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:16.892282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:16.892567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:16.892837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:16.906709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:16.908767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:16.925384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:16.926775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:16.938256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 960/1942] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:16.994183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:16.997869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:17.010410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30628bde-9557-4d39-850e-200515a534ce service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:17.012451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 983/1943] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:17.029426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:17.035381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:17.100999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:17.153960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25a9e-6cea-40de-bc4c-24d56a7e2b54 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:17.155059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:17.160120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:17.160749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:17.161028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:17.161343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:17.164682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:17.165586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:17.166479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:17.166756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:17.172833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:17.174307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:17.175405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:17.186530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 984/1944] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:17.269843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:17.271666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:17.282471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 961/1945] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:17.885875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:17.887493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:17.901184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97303370-1042-4cf4-b3d5-68816f0c6aa3 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:17.905843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:17.906451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:17.906726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:17.907010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] PATH_INFO: `/v3/projects/0b56da6fd0e543a9b77e4a47ac9edd9c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:17.908243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b56da6fd0e543a9b77e4a47ac9edd9c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:17.910184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:17.960560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b56da6fd0e543a9b77e4a47ac9edd9c', 'request_id': 'req-b36b4e8d-c17c-4479-8e5f-dd83031410c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:17.966605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b56da6fd0e543a9b77e4a47ac9edd9c', 'request_id': 'req-b36b4e8d-c17c-4479-8e5f-dd83031410c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:17.973397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b56da6fd0e543a9b77e4a47ac9edd9c', 'request_id': 'req-b36b4e8d-c17c-4479-8e5f-dd83031410c0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:17.986213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] The token cache is being invalidate because project 0b56da6fd0e543a9b77e4a47ac9edd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:17.986504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:17.987139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:17.989109 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 985/1946] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:17 2022] DELETE /identity/v3/projects/0b56da6fd0e543a9b77e4a47ac9edd9c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:17.993300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:18.005435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814fa2-9cca-4379-ad5d-451386c59cfb service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:18.068805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:18.069712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.069983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.070254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] PATH_INFO: `/v3/users/dd89cbb9f611403ab2085679f0c659e7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.071367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd89cbb9f611403ab2085679f0c659e7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:18.073404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:18.137420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd89cbb9f611403ab2085679f0c659e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.138086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd89cbb9f611403ab2085679f0c659e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.145369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd89cbb9f611403ab2085679f0c659e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.153059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd89cbb9f611403ab2085679f0c659e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.153835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-d715698d-3765-4bfd-bbba-034dd60f9cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd89cbb9f611403ab2085679f0c659e7'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.175861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 962/1947] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:17 2022] DELETE /identity/v3/users/dd89cbb9f611403ab2085679f0c659e7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:18.458974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:18.460520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:18.487683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4e8d-c17c-4479-8e5f-dd83031410c0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:18.552143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:18.553320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.553838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.554483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] PATH_INFO: `/v3/projects/ab05a7f181da4687a6892403f8ea1ccc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.555414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab05a7f181da4687a6892403f8ea1ccc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:18.557527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:18.613320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab05a7f181da4687a6892403f8ea1ccc', 'request_id': 'req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.618003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:18.619407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab05a7f181da4687a6892403f8ea1ccc', 'request_id': 'req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.638007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab05a7f181da4687a6892403f8ea1ccc', 'request_id': 'req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.650474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] The token cache is being invalidate because project ab05a7f181da4687a6892403f8ea1ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:18.650778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.651575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-339aa2d9-43c3-44d8-b461-ef74e5d3f0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:18.660195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 986/1948] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:18 2022] DELETE /identity/v3/projects/ab05a7f181da4687a6892403f8ea1ccc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:18.661305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.661534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.661880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.683161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:18.684515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:18.708008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:18.793679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.793993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.794231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.798588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 963/1949] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:18.817713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:18.818999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:18.834282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 987/1950] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:18.839469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:18.851602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961ec2-718b-4604-b526-5aa278a8597a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:18.864594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:18.865219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.865491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.865755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.866409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:18.866705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:18.868862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:18.895537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 964/1951] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:18.900225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:18.913919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddf30c-e03d-409a-be1f-a47c6831f40f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:18.924795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:18.925427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:18.925733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:18.926004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:18.926640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:18.928601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:18.971757 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 988/1952] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:18 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:18.976133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:18.986218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b85687-ef81-43b0-b6c0-ca8256b74eb5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.052508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.055662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.056092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.056363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.057722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.059668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.084892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 965/1953] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:18 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:19.089172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.099259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5037f7-8c1c-4787-8a92-9ccdb8f937bf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.104013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.104644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.104920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.106502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.106799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.114648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.127297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 989/1954] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:19.131336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.141968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dc454-79ff-41ff-a7a0-ecad62b97556 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.147061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.147596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.147872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.148198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.148855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.150419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3ac76-7fb5-4c49-9c70-705a6199d1d6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.161434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 966/1955] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:19.165803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.176045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23e067-faa8-497d-9fa3-a3c844b04f70 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.180724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.181487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.181830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.182191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] PATH_INFO: `/v3/projects/d404b5e96b334d78b0dca42468b630cc/users/22002a87b2214a609a6da1bccf616144/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.199408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d404b5e96b334d78b0dca42468b630cc, user_id=22002a87b2214a609a6da1bccf616144, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.203068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.218658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 990/1956] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:19 2022] PUT /identity/v3/projects/d404b5e96b334d78b0dca42468b630cc/users/22002a87b2214a609a6da1bccf616144/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:19.228998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.229502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.229965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.259993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] MFA Rules not processed for user `22002a87b2214a609a6da1bccf616144`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:19.261230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:19.340912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 967/1957] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:19.345440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.363359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.365185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:19.431684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:19.453962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e003-c184-449d-af88-db371b7f19de admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.460038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.460965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.461245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.461579 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.462211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.464372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.503585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 991/1958] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:19 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:19.504648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.525739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f049bb-73ea-4390-ab56-5c6906140751 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.595098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.595877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.595987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d551-5c4f-4163-9d34-f02834963a94 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.596281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.596638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] PATH_INFO: `/v3/users/68055a8f4448428a87c21b4cee8dd8cd` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.597852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68055a8f4448428a87c21b4cee8dd8cd)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.600457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.601469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.602223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.602653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.602929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.603905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.608286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.622313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:19.647736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 992/1959] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:19 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:19.648808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.661356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac17ed1-6817-4d1a-a4a0-9ab70a0f1538 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.668329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.668863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.669142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.669411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.670252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.672495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.689511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68055a8f4448428a87c21b4cee8dd8cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:19.690770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68055a8f4448428a87c21b4cee8dd8cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:19.691542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 993/1960] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:19.692460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.703557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d5f-dfba-4f88-bcf9-ce2cfbc45158 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.706596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68055a8f4448428a87c21b4cee8dd8cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:19.710982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.710982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.711259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.711723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] PATH_INFO: `/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f/users/490f32f8315b409fba0c52ef8025dc43/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.721664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68055a8f4448428a87c21b4cee8dd8cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:19.724458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-efc91afc-e5a1-47b4-9453-35b03f6c30b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68055a8f4448428a87c21b4cee8dd8cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:19.749826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e34ef2eacc49d28f07b9c2d73e152f, user_id=490f32f8315b409fba0c52ef8025dc43, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.755905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.775968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 968/1961] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:19 2022] DELETE /identity/v3/users/68055a8f4448428a87c21b4cee8dd8cd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:19.781471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.781998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.783223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.794571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 994/1962] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:19 2022] PUT /identity/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f/users/490f32f8315b409fba0c52ef8025dc43/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:19.799148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.802799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:19.813837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:19.815176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:19.896941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:19.916897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be59cd-398d-4bcd-8df9-2cb0c49f4e1c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.924264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.924959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.925304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.925642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.926592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.928577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:19.937753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 969/1963] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:19.946648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 995/1964] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:19.949390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.950444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:19.952620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:19.961874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09815a2d-d093-42b4-9fbc-cc890834bed7 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:19.970857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:19.971783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:19.972072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:19.972432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] PATH_INFO: `/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f/users/490f32f8315b409fba0c52ef8025dc43/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:19.974958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e34ef2eacc49d28f07b9c2d73e152f, user_id=490f32f8315b409fba0c52ef8025dc43, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:19.977959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acecf0-3689-460e-b27e-4d53537031de admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:20.003715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 970/1965] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:19 2022] PUT /identity/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f/users/490f32f8315b409fba0c52ef8025dc43/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:20.019119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.019421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.019668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.052830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fb69f-a997-4823-94ed-f187125260f1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:20.084562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] MFA Rules not processed for user `490f32f8315b409fba0c52ef8025dc43`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:20.085991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:20.144597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:20.146244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.146244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.146244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.190389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:20.206797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 971/1966] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:20.225625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:20.228412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:20.267728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:20.269979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:20.288654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 996/1967] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:20.296199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd9e76-18bb-4ef3-8e6c-c09a73b79142 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:20.300897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:20.301674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.302022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.302369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.313919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:20.317520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31e41b-ef10-4ba9-9029-ca2483743e79 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:20.332537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 972/1968] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:20.441393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:20.455881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9e4c6-032d-47f2-8c76-f02e50271d32 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:20.460322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:20.461768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.462669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.462669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] PATH_INFO: `/v3/users/22002a87b2214a609a6da1bccf616144` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.463978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22002a87b2214a609a6da1bccf616144)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:20.466409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:20.533447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22002a87b2214a609a6da1bccf616144'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:20.534265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22002a87b2214a609a6da1bccf616144'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:20.549197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22002a87b2214a609a6da1bccf616144'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:20.550394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22002a87b2214a609a6da1bccf616144'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:20.565563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22002a87b2214a609a6da1bccf616144'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:20.582939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 997/1969] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:20 2022] DELETE /identity/v3/users/22002a87b2214a609a6da1bccf616144 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:20.587302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.587588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.587883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.633314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:20.634772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:20.720037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:20.735976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 973/1970] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:20.748564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:20.750948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:20.865482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7d38-d936-47d7-ae8b-7029d5011d17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:20.887431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:20.888371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:20.888902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:20.889424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:20.917376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:20.919164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed830a-e0c0-4f1c-ae45-c3030cbd9ef5 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:20.941638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 998/1971] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:21.009210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.010911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.035243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b1fc-13ff-4ae3-8285-646196a78ff3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.044965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.049122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.049439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.052713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] PATH_INFO: `/v3/projects/f342fc06e9fc4ec2b26f67abcdaa4425` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.055761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f342fc06e9fc4ec2b26f67abcdaa4425)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.060585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.129546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f342fc06e9fc4ec2b26f67abcdaa4425', 'request_id': 'req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.137503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f342fc06e9fc4ec2b26f67abcdaa4425', 'request_id': 'req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.147320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f342fc06e9fc4ec2b26f67abcdaa4425', 'request_id': 'req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.174705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] The token cache is being invalidate because project f342fc06e9fc4ec2b26f67abcdaa4425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:21.175016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.175906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.177862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 974/1972] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:21 2022] DELETE /identity/v3/projects/f342fc06e9fc4ec2b26f67abcdaa4425 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:21.184135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac69d2-0ceb-4193-b19c-2f2b5c372d8d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.184500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac69d2-0ceb-4193-b19c-2f2b5c372d8d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.184923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac69d2-0ceb-4193-b19c-2f2b5c372d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.209311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.211036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.227794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3eac69d2-0ceb-4193-b19c-2f2b5c372d8d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:21.234880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3eac69d2-0ceb-4193-b19c-2f2b5c372d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.317668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:21.371427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c6c40-d7e2-4b1e-b984-b0e0116db1d1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.377997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.378649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.378929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.379354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] PATH_INFO: `/v3/users/518c3a9e9d3046238507554f223f9d8b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.381120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518c3a9e9d3046238507554f223f9d8b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.384085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.394683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 999/1973] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:21.402032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.402874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.403390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.427923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:21.430027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.440371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1000/1974] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:21.444644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.456038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518c3a9e9d3046238507554f223f9d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.456263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b1f39-75c5-4dd2-bcfa-7249af647efc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.457868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518c3a9e9d3046238507554f223f9d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.468397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.469729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.470101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.470587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.471369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:21.472421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.473529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.489426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1001/1975] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:21.494143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.507812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e224a-7740-45a1-927b-15173ff21318 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.511927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518c3a9e9d3046238507554f223f9d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.513790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.514483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.515530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.515723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.516616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.519774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.541749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518c3a9e9d3046238507554f223f9d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.544167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ba93ae4-9c41-4663-bebc-56f9c08220c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518c3a9e9d3046238507554f223f9d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:21.567737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1002/1976] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:21 2022] POST /identity/v3/projects => generated 359 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:21.572224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.575728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.593749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 975/1977] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:21 2022] DELETE /identity/v3/users/518c3a9e9d3046238507554f223f9d8b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:21.599900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.600261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.600836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.616429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:21.653869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:21.655338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.709815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ade0-31ec-4a24-a200-d4b9e12e93f0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.746184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 976/1978] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:21.771597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.776835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:21.787666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.788466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.788753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.789108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.790181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.793166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.824964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1003/1979] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:21 2022] POST /identity/v3/users => generated 280 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:21.837912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.855683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e870d-d632-4dc4-b87f-e5d3bad6a3c8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.864561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c456ab-1f13-4248-9e44-382699ed7c8b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.868411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.869347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.869482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.869698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.871780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.871919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.872236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.872534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.873148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.874997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.886136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.886351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1004/1980] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:21.890842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.891345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a18917-4d2b-492a-af3a-7f1eda421d50 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.906616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeba3a-af70-4e32-ab24-98ae2a462119 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.912606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.914296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.914723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.915136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:21.916024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:21.918111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:21.933545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1005/1981] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:21.939699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:21.942162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 977/1982] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:21.966859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b4290-4352-4f00-9833-c83d786b2e41 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:21.981762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:21.982480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:21.982796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:21.983239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] PATH_INFO: `/v3/projects/bbacaff19df94e2d910165f4fbaee8f9/users/013d6f3ea8f64807b4b9a7f3f995ad49/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.001876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:22.014306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbacaff19df94e2d910165f4fbaee8f9, user_id=013d6f3ea8f64807b4b9a7f3f995ad49, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:22.018610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:22.048097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1006/1983] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:21 2022] PUT /identity/v3/projects/bbacaff19df94e2d910165f4fbaee8f9/users/013d6f3ea8f64807b4b9a7f3f995ad49/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:22.060136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.062098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.062386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.117518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] MFA Rules not processed for user `013d6f3ea8f64807b4b9a7f3f995ad49`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:22.120148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.231854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 978/1984] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:22.271446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:22.273525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.346312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5812f3-f4d7-48b0-9a84-3367973c83c6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:22.350347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:22.350965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.351241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.351511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.363240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:22.365223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:22.382396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1007/1985] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:22.401978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:22.508964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:22.567219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc02a-b94e-4eee-97e7-c7b69a96a42a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:22.584549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:22.585491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.585951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.586404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] PATH_INFO: `/v3/users/013d6f3ea8f64807b4b9a7f3f995ad49` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.588536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013d6f3ea8f64807b4b9a7f3f995ad49)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:22.590825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:22.680955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:22.683929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.696804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013d6f3ea8f64807b4b9a7f3f995ad49'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.697494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013d6f3ea8f64807b4b9a7f3f995ad49'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.733418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013d6f3ea8f64807b4b9a7f3f995ad49'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.735389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0fffa-8ee4-4e2e-8055-f6942755e78c service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:22.745503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:22.746182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.746884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.746884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] PATH_INFO: `/v3/projects/6aa00cf0ff7a47dd8afc5439c963f488` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.748018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa00cf0ff7a47dd8afc5439c963f488)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:22.750055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:22.752210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013d6f3ea8f64807b4b9a7f3f995ad49'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.755323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013d6f3ea8f64807b4b9a7f3f995ad49'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.797170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 979/1986] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:22 2022] DELETE /identity/v3/users/013d6f3ea8f64807b4b9a7f3f995ad49 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:22.798126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:22.800846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.831275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa00cf0ff7a47dd8afc5439c963f488', 'request_id': 'req-0913059d-4629-4240-b1a4-fceeaa7e6927'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.837706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa00cf0ff7a47dd8afc5439c963f488', 'request_id': 'req-0913059d-4629-4240-b1a4-fceeaa7e6927'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.845393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa00cf0ff7a47dd8afc5439c963f488', 'request_id': 'req-0913059d-4629-4240-b1a4-fceeaa7e6927'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.861893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] The token cache is being invalidate because project 6aa00cf0ff7a47dd8afc5439c963f488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:22.862430 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.863529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0913059d-4629-4240-b1a4-fceeaa7e6927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:22.866263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1008/1987] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:22 2022] DELETE /identity/v3/projects/6aa00cf0ff7a47dd8afc5439c963f488 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:22.867056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.867503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.868024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.889808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0ff5e-2e96-496b-b4d4-1ceecba76f02 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:22.891505 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:22.892888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.966516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:22.967266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:22.967621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:22.968806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1009/1988] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:22.969390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] PATH_INFO: `/v3/projects/d404b5e96b334d78b0dca42468b630cc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:22.970003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:22.970637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d404b5e96b334d78b0dca42468b630cc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:22.971469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:22.973015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:22.980758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:23.001026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e6830-aa83-4d5d-8ad4-eb3be4572775 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:23.009252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:23.010346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:23.011007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:23.011481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] PATH_INFO: `/v3/users/1a97aad16ae34d7db0cdc4f2bf7b50c4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:23.012996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a97aad16ae34d7db0cdc4f2bf7b50c4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:23.015359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:23.022636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:23.035201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd404b5e96b334d78b0dca42468b630cc', 'request_id': 'req-381c004a-87ac-4a71-8670-6d4ca02d6607'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.042543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd404b5e96b334d78b0dca42468b630cc', 'request_id': 'req-381c004a-87ac-4a71-8670-6d4ca02d6607'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.067798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd404b5e96b334d78b0dca42468b630cc', 'request_id': 'req-381c004a-87ac-4a71-8670-6d4ca02d6607'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.087044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] The token cache is being invalidate because project d404b5e96b334d78b0dca42468b630cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:23.087337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.087911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a97aad16ae34d7db0cdc4f2bf7b50c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.088014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.089073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a97aad16ae34d7db0cdc4f2bf7b50c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.092738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 980/1989] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:22 2022] DELETE /identity/v3/projects/d404b5e96b334d78b0dca42468b630cc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:23.092738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:23.094284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:23.132936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a97aad16ae34d7db0cdc4f2bf7b50c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.134209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a97aad16ae34d7db0cdc4f2bf7b50c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.148262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a97aad16ae34d7db0cdc4f2bf7b50c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.184261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c004a-87ac-4a71-8670-6d4ca02d6607 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:23.188548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:23.189172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:23.189746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:23.190170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:23.192201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:23.193678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1010/1990] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:22 2022] DELETE /identity/v3/users/1a97aad16ae34d7db0cdc4f2bf7b50c4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:23.201287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:23.204709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:23.282065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89555-f19c-46b4-9f84-fbb03995a535 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:23.288116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:23.288880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:23.289237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:23.289582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] PATH_INFO: `/v3/users/490f32f8315b409fba0c52ef8025dc43` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:23.290890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490f32f8315b409fba0c52ef8025dc43)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:23.294773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:23.348764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:23.351698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:23.365821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 981/1991] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:23.373325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490f32f8315b409fba0c52ef8025dc43'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.374746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490f32f8315b409fba0c52ef8025dc43'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.392744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490f32f8315b409fba0c52ef8025dc43'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.393868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490f32f8315b409fba0c52ef8025dc43'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.404290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490f32f8315b409fba0c52ef8025dc43'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:23.434196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1011/1992] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:23 2022] DELETE /identity/v3/users/490f32f8315b409fba0c52ef8025dc43 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:23.964180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:23.965638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:23.979932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41564c63-0c78-48dd-b6b4-b9956846e194 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.042401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:24.082583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.084400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.084766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.086009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] PATH_INFO: `/v3/projects/74a09d2f92ad4566924643e646e44a8d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.088045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a09d2f92ad4566924643e646e44a8d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.091126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.093396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.096001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.112658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:24.137821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a97e6-4c81-4b14-83a6-8dba081a15a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.163323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a09d2f92ad4566924643e646e44a8d', 'request_id': 'req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.174131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a09d2f92ad4566924643e646e44a8d', 'request_id': 'req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.188318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a09d2f92ad4566924643e646e44a8d', 'request_id': 'req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.209285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] The token cache is being invalidate because project 74a09d2f92ad4566924643e646e44a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:24.209734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.210538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-83fb4274-08da-44c0-a7ca-dc2d4f198f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.216478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 982/1993] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:23 2022] DELETE /identity/v3/projects/74a09d2f92ad4566924643e646e44a8d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:24.217425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab898-6211-48b3-976b-05aa2d051fbb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.217875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab898-6211-48b3-976b-05aa2d051fbb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.218270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ab898-6211-48b3-976b-05aa2d051fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.240653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-481ab898-6211-48b3-976b-05aa2d051fbb None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:24.241491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-481ab898-6211-48b3-976b-05aa2d051fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.251999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.253368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.253882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.254305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] PATH_INFO: `/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.255920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e34ef2eacc49d28f07b9c2d73e152f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.258525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.339736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 983/1994] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:24.348789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61805-e5df-4b3a-8cfd-2f26120c819c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.349046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61805-e5df-4b3a-8cfd-2f26120c819c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.352311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61805-e5df-4b3a-8cfd-2f26120c819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.383130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e34ef2eacc49d28f07b9c2d73e152f', 'request_id': 'req-acfd5398-8663-4724-9bbd-a4a52510bd47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.385143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-33f61805-e5df-4b3a-8cfd-2f26120c819c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:24.386496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-33f61805-e5df-4b3a-8cfd-2f26120c819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.390510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e34ef2eacc49d28f07b9c2d73e152f', 'request_id': 'req-acfd5398-8663-4724-9bbd-a4a52510bd47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.398467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e34ef2eacc49d28f07b9c2d73e152f', 'request_id': 'req-acfd5398-8663-4724-9bbd-a4a52510bd47'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.416900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] The token cache is being invalidate because project 66e34ef2eacc49d28f07b9c2d73e152f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:24.417300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.418315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.419877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1012/1995] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:24 2022] DELETE /identity/v3/projects/66e34ef2eacc49d28f07b9c2d73e152f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:24.425621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.426984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.464103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 984/1996] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:24.464103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.464103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.464103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.487137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:24.488616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.505023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 985/1997] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:24.506250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.517450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97de0f-a551-4e04-9e0a-b8daf2d5cd73 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.522334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.523587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.523871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.524257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.524980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:24.525301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.526237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd5398-8663-4724-9bbd-a4a52510bd47 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.527139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf771f7d-008a-4653-9b9e-12ed0322558e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.529266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:24.532975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.535091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.535091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.535091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] PATH_INFO: `/v3/projects/bbacaff19df94e2d910165f4fbaee8f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.536046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbacaff19df94e2d910165f4fbaee8f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.537728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.546965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 986/1998] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:24.548824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.549466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.549964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.573892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:24.575976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.586572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:24.589902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 987/1999] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:24.590991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.606679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b91331-dc1a-42e1-be61-50025a4138a3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.613419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbacaff19df94e2d910165f4fbaee8f9', 'request_id': 'req-053d475f-ffc7-4bbd-975e-8652ed3f32b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.626748 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbacaff19df94e2d910165f4fbaee8f9', 'request_id': 'req-053d475f-ffc7-4bbd-975e-8652ed3f32b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.644483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbacaff19df94e2d910165f4fbaee8f9', 'request_id': 'req-053d475f-ffc7-4bbd-975e-8652ed3f32b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.665952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] The token cache is being invalidate because project bbacaff19df94e2d910165f4fbaee8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:24.666495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.667799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:24.670714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1013/2000] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:24 2022] DELETE /identity/v3/projects/bbacaff19df94e2d910165f4fbaee8f9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:24.676926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.678526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.713418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.714122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.714615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.714958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.733197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.735383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52dcd7-40ad-4538-951b-69b15566826d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.789623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 988/2001] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:24.791783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.792232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.792846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.793045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d475f-ffc7-4bbd-975e-8652ed3f32b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:24.837165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:24.841278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.906942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:24.909427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:24.910463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:24.911092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:24.912834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:24.921969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:24.932389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:24.972794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1014/2002] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:24.979150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:24.982453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 989/2003] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:24.983951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:24.984883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.000826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3385-8ba2-4b1e-8df7-5934eeb197d2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.013162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.015603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c626f-5845-4ec0-8ab2-86ef834129d4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.015922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.016552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.016669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.018477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.023646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7024f-1648-4fad-9c45-1dbd06d414d0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.028328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.029985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.030917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.031442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.032959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.041831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.097310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1015/2004] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:25.097829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 990/2005] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:24 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:25.099102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.099389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.099920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.101040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.112746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfb811-8437-4eb3-ba04-021f71d2a48b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.122804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:25.124261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:25.169102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:25.186761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.187916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.188460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.188947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.190084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.192052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.210000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:25.213150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1016/2006] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.213150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.223254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd88c-ad92-48d5-a33d-55bb8afd291a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.231914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.234337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.234701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.236170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.236933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.238891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.242102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 991/2007] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:25.243136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.254548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d25c4-940a-4013-b5d6-34d4492cf2fc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.260782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.261541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.262086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.262392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.263043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.264770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.271961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1017/2008] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:25.271961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.282653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 992/2009] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.282822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0611d-91cf-48a9-80a2-1733a636a65f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.283921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.290209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.290894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.291261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.291584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.292413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:25.292694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.294386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.294499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08133f-adf0-4ee4-8a6d-eb3a741fc0f8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.300554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.301215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.301510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.301854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.302505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.304223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.309078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1018/2010] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:25.310403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.314900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 993/2011] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.315609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.324709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1703c8-a75a-4eb3-8cab-e7dbf5819b61 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.325797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226d7c-9197-4c63-9cdb-9b7061b4990b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.330985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.331696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.331982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.332305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] PATH_INFO: `/v3/projects/a821e1193b344fb580be1d4533a8a4a6/users/dc2db5ebfd5845208a50fcb19fa134b1/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.332829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.333587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.333882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.334165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.334853 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.337178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.353080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a821e1193b344fb580be1d4533a8a4a6, user_id=dc2db5ebfd5845208a50fcb19fa134b1, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.355830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.372199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 994/2012] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:25.372199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.375808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1019/2013] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:25 2022] PUT /identity/v3/projects/a821e1193b344fb580be1d4533a8a4a6/users/dc2db5ebfd5845208a50fcb19fa134b1/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:25.377807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.456191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e348b53-ea8f-4d76-99b7-9a53b0673fdc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.461681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.462613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.462892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.463350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.464104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.465796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bdef7-69ff-4b94-9bd0-f8a31e9fcec6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.474600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90c318-c7a3-492a-a89f-63bfb64f8854 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.480080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.480641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 995/2014] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.480826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.481204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.481704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.481942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc351-9237-4f8d-877b-3ad8a76f7ec2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.482223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc351-9237-4f8d-877b-3ad8a76f7ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.482493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc351-9237-4f8d-877b-3ad8a76f7ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.482608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.486226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.515103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d80dc351-9237-4f8d-877b-3ad8a76f7ec2 None None] MFA Rules not processed for user `dc2db5ebfd5845208a50fcb19fa134b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:25.516637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d80dc351-9237-4f8d-877b-3ad8a76f7ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:25.521752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1020/2015] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:25.521752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.533207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57198-a947-44a3-bafa-bd191650dc10 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.540345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.541500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.541960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.542406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] PATH_INFO: `/v3/projects/ea098ecb235a466d850acbc60c3e54b0/users/06a36df93eeb408d80edcd75c2f8e5aa/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.565152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea098ecb235a466d850acbc60c3e54b0, user_id=06a36df93eeb408d80edcd75c2f8e5aa, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.568492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.586499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1021/2016] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:25 2022] PUT /identity/v3/projects/ea098ecb235a466d850acbc60c3e54b0/users/06a36df93eeb408d80edcd75c2f8e5aa/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:25.588090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.623046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 996/2017] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:25.624962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.625311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.625805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.665958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] MFA Rules not processed for user `06a36df93eeb408d80edcd75c2f8e5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:25.667629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:25.668338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:25.676969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b65abe-f965-48b3-849e-f9d3759425a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.683219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.684098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.684556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.685029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.685834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.687723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.695091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:25.701839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1022/2018] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.702914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.706990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:25.783400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 997/2019] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:25.785348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.800527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8a797-1bce-4f85-bc89-4770f4de3232 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.800967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9e85e-77af-40fe-874b-1ee9906c9088 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.804977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.805657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.805970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.806104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.806362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.806576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.806908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.807249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.807883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.809561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.821247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 998/2020] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:25.822326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.824942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:25.837286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd1d4-9dfe-4f11-ba89-fe98256ee934 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.840941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.841672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.841953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.842222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.853787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.855375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.866201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 999/2021] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:25.866831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:25.878048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8210-b282-4ab6-992d-516c0ed69e70 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:25.880146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.881728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fb864-f955-44c1-a587-db0c46d56e07 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.884376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:25.885404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.885887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.886345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] PATH_INFO: `/v3/projects/01e13f7ddaf34e50ab54627a8541abb5/users/3386d02e3c3846b48074b02f4889bba5/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.902740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1023/2022] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:25.903476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e13f7ddaf34e50ab54627a8541abb5, user_id=3386d02e3c3846b48074b02f4889bba5, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:25.907139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:25.927131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1000/2023] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:25 2022] PUT /identity/v3/projects/01e13f7ddaf34e50ab54627a8541abb5/users/3386d02e3c3846b48074b02f4889bba5/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:25.931857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20281e2d-0c61-4591-b8d5-6eafc51ff506 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:25.932173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20281e2d-0c61-4591-b8d5-6eafc51ff506 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:25.932462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20281e2d-0c61-4591-b8d5-6eafc51ff506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:25.956266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20281e2d-0c61-4591-b8d5-6eafc51ff506 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:25.957624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20281e2d-0c61-4591-b8d5-6eafc51ff506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:26.037537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1024/2024] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:26.049452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:26.051709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:26.128253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ff1e-ee77-4967-9d75-e6a4c6d02610 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:26.133299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:26.134173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:26.134528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:26.134745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:26.150102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:26.151760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b626-4c36-47ae-bc53-d56b87a572f3 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:26.162562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1001/2025] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:27.245422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:27.246935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:27.247354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:27.279405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] MFA Rules not processed for user `3386d02e3c3846b48074b02f4889bba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:27.281565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:27.340012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:27.400985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1025/2026] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:27.412285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35781-6c25-4b50-892f-dfdc600374ff None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:27.412782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35781-6c25-4b50-892f-dfdc600374ff None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:27.412859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35781-6c25-4b50-892f-dfdc600374ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:27.419075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:27.437372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d9f35781-6c25-4b50-892f-dfdc600374ff None None] MFA Rules not processed for user `06a36df93eeb408d80edcd75c2f8e5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:27.439189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d9f35781-6c25-4b50-892f-dfdc600374ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:27.522828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1002/2027] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:27.567412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fba3-ed65-4504-bc7c-c91cee33311d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:27.581168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:27.582181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:27.582427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:27.582704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:27.598138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:27.599870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:27.611367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1026/2028] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:29.242128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:29.242622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:29.242711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:29.270520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] MFA Rules not processed for user `3386d02e3c3846b48074b02f4889bba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:29.271998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:29.279946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1003/2029] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:36.767429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:36.769154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:36.785339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f795ab-054a-4c9d-9535-f83b29c516bf service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:36.791256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:36.792175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:36.792461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:36.792805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] PATH_INFO: `/v3/users/2ef6382c2b9e416c95938c18c0c79307` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:36.794632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef6382c2b9e416c95938c18c0c79307)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:36.797442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:36.859258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef6382c2b9e416c95938c18c0c79307'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:36.859952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef6382c2b9e416c95938c18c0c79307'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:36.878678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef6382c2b9e416c95938c18c0c79307'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:36.879477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef6382c2b9e416c95938c18c0c79307'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:36.889190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24813199-e6c9-49d6-8038-cbc4b64455e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef6382c2b9e416c95938c18c0c79307'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:36.903097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1027/2030] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:36 2022] DELETE /identity/v3/users/2ef6382c2b9e416c95938c18c0c79307 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:37.082539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.099246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309edf29-50e1-46c1-b8f5-ba64bf47ef7e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.113911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:37.160498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.161636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.161926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.162207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] PATH_INFO: `/v3/projects/a78d45e3e11f48e89fbc946bd4ed2b64` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.163311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78d45e3e11f48e89fbc946bd4ed2b64)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.165292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.223308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78d45e3e11f48e89fbc946bd4ed2b64', 'request_id': 'req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:37.229044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78d45e3e11f48e89fbc946bd4ed2b64', 'request_id': 'req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:37.238813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78d45e3e11f48e89fbc946bd4ed2b64', 'request_id': 'req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:37.253752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] The token cache is being invalidate because project a78d45e3e11f48e89fbc946bd4ed2b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:37.254199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:37.254839 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6fbdc2d-3aba-4ae1-a8a0-07b5d73ca906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:37.256396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1004/2031] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:37 2022] DELETE /identity/v3/projects/a78d45e3e11f48e89fbc946bd4ed2b64 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:37.261331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.261621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.261917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.282175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:37.283380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:37.335047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:37.352593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1028/2032] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:37.361501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.361785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.362053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.381678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:37.382898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:37.391584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1005/2033] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:37.395915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.406147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5fc2d-9992-46ee-a38e-bbcc9fb9e899 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.410826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.411424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.411702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.411970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.412702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:37.413003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.414580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.426268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1029/2034] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:37.430580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.439979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780300-39bb-4869-ba68-8e79dfd16396 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.444607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.445203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.445482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.445754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.446383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.448307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.479396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1006/2035] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:37 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:37.480572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.490418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b445-a719-4a91-ab73-31a5d5eaa196 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.545672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.546268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.546549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.546820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.547426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.549366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.570235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1030/2036] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:37 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:37.574239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.585183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cc568-8f1a-4e4b-8fa0-d285aa9c0dd3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.590125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.590729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.591009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.591283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.591928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.594125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.604283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1007/2037] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:37.608181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.618796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81a2-3a2c-4d46-a98c-28b1caa88781 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.623446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.624046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.624348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.624617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.625251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.626829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edad3af-88ce-4493-abd4-964025cf1315 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.642894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1031/2038] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:37.644577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.654655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af28409-cb9b-449c-ab32-ca5543887220 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.660081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.660829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.661195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.661534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] PATH_INFO: `/v3/projects/8edd0c96656e451db4c1096b97d29165/users/140f19356d1c4875984b5346dba770f0/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.676443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edd0c96656e451db4c1096b97d29165, user_id=140f19356d1c4875984b5346dba770f0, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.679168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.693932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1008/2039] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:37 2022] PUT /identity/v3/projects/8edd0c96656e451db4c1096b97d29165/users/140f19356d1c4875984b5346dba770f0/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:37.704778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.705150 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.705484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.736829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] MFA Rules not processed for user `140f19356d1c4875984b5346dba770f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:37.738041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:37.800808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1032/2040] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:37.811889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:37.813632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:37.858433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:37.890089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85301e-be16-4201-9519-cfdf2fb4471d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:37.896141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:37.896741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:37.897023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:37.897295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:37.904783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:37.906367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b28293-6a3f-426a-85e7-47a3e7ff2f18 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:37.914899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1009/2041] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:38.172681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:38.174025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:38.249970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:38.276836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef4c0-5a4f-42cf-a467-9674fa3918d8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:38.283650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:38.284484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:38.284768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:38.285043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] PATH_INFO: `/v3/users/dc2db5ebfd5845208a50fcb19fa134b1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:38.286543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2db5ebfd5845208a50fcb19fa134b1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:38.289785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:38.388975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2db5ebfd5845208a50fcb19fa134b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:38.391118 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2db5ebfd5845208a50fcb19fa134b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:38.424240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2db5ebfd5845208a50fcb19fa134b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:38.425381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2db5ebfd5845208a50fcb19fa134b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:38.448393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2db5ebfd5845208a50fcb19fa134b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:38.472566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1033/2042] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:38 2022] DELETE /identity/v3/users/dc2db5ebfd5845208a50fcb19fa134b1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:38.477829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:38.478661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:38.479111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:38.504472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:38.505820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:38.582480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1010/2043] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:38.591991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:38.593974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:38.656243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ece9c-4e00-4b5c-a07f-69ba3b5bdcb9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:38.665535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:38.668970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:38.669284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:38.669605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:38.682312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:38.683900 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087af8f6-c30c-484c-99bb-85e0e592672b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:38.693897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1034/2044] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:39.046243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.047796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:39.059848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec827-64bd-46ed-8151-48e955494a5a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.064613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.065248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.065535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.065809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] PATH_INFO: `/v3/projects/a821e1193b344fb580be1d4533a8a4a6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.066915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a821e1193b344fb580be1d4533a8a4a6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.068961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.116741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a821e1193b344fb580be1d4533a8a4a6', 'request_id': 'req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:39.122224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a821e1193b344fb580be1d4533a8a4a6', 'request_id': 'req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:39.129237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a821e1193b344fb580be1d4533a8a4a6', 'request_id': 'req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:39.140830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] The token cache is being invalidate because project a821e1193b344fb580be1d4533a8a4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:39.141118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:39.141790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b52045ad-6b6b-42a5-95ea-fcc1c2891a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:39.143215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1011/2045] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:39 2022] DELETE /identity/v3/projects/a821e1193b344fb580be1d4533a8a4a6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:39.147988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.148483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.148586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.168489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:39.169684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:39.229368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1035/2046] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:39.237340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.237626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.237897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.257568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:39.258741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:39.268072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1012/2047] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:39.272191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.281686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1748-f6f8-4659-a1dc-764a7f2e3817 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.286136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.286720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.286998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.287268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.287896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:39.288224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.289831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.292121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:39.304234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1036/2048] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:39.306090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.315541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e981ab-c2d3-4a4f-9bc0-562a86188c5e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.320103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.320690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.320965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.321234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.321844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.323748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.349784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1013/2049] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:39 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:39.353773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.363504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a60a-8eb2-4a23-8de1-d6fc2f2937ba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.417682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.418205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.418487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.418761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.419368 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.421310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.442912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1037/2050] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:39 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:39.446851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.457997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1208484-e77f-4aad-8290-b28cf7dab5df admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.462607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.463203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.463494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.463772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.464410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.465980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.476049 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1014/2051] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:39.479877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.492939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4ec8-935d-4960-848a-64da0c101383 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.497692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.498291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.499083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.499354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.499984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.501583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59106ead-3f44-43f9-98d5-0d708ff2ee49 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.512841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1038/2052] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:39.517641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.527726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900141a-f0b2-43a3-935e-e7721f16675f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.532315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.532962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.533239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.533509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] PATH_INFO: `/v3/projects/62442419687c41489ef2922d8c98afbc/users/4ce914d787414156bd330d6082d2bfd4/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.543671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:39.556921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62442419687c41489ef2922d8c98afbc, user_id=4ce914d787414156bd330d6082d2bfd4, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.560587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.574578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1015/2053] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:39 2022] PUT /identity/v3/projects/62442419687c41489ef2922d8c98afbc/users/4ce914d787414156bd330d6082d2bfd4/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:41:39.585012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.585298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.585571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.615635 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] MFA Rules not processed for user `4ce914d787414156bd330d6082d2bfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:39.616918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:39.701943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1039/2054] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:39.715334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:39.721730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:39.788389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a765a8-401e-4b24-a03d-5454ccfb0e89 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:39.792181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:39.792925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:39.793268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:39.793608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:39.803389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:39.804926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640646d-61bf-4876-9ea0-1436c74e4219 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:39.814657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1016/2055] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:40.767380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:40.769204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:40.851664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df224554-1386-4072-8a73-4578bd7c62a2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:40.856369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:40.857083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:40.857434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:40.857717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] PATH_INFO: `/v3/users/140f19356d1c4875984b5346dba770f0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:40.858982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140f19356d1c4875984b5346dba770f0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:40.864205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:40.867497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:40.945969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140f19356d1c4875984b5346dba770f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:40.946639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140f19356d1c4875984b5346dba770f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:40.975805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140f19356d1c4875984b5346dba770f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:40.979671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140f19356d1c4875984b5346dba770f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:40.991852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140f19356d1c4875984b5346dba770f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.007449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1040/2056] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:40 2022] DELETE /identity/v3/users/140f19356d1c4875984b5346dba770f0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:41.012102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.013101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.013561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.037677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:41.038894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:41.105020 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1017/2057] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:41.115700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.117273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:41.180763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3c77-b8ef-4b86-a78b-765831a76c55 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.184483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.185123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.185399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.185670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.197202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.198639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b8fe-a379-4b0e-a328-6dd0919cb4c2 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:41.208960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1041/2058] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:41.553347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.554939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:41.568651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380c0c-6a12-45d4-97b2-347165e00fdc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.573423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.574130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.574478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.574823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] PATH_INFO: `/v3/projects/8edd0c96656e451db4c1096b97d29165` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.576097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edd0c96656e451db4c1096b97d29165)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.578120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:41.627289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edd0c96656e451db4c1096b97d29165', 'request_id': 'req-14681d4d-1a00-453c-aa30-5b96d5fa0b22'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.633064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edd0c96656e451db4c1096b97d29165', 'request_id': 'req-14681d4d-1a00-453c-aa30-5b96d5fa0b22'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.641183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edd0c96656e451db4c1096b97d29165', 'request_id': 'req-14681d4d-1a00-453c-aa30-5b96d5fa0b22'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.653328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] The token cache is being invalidate because project 8edd0c96656e451db4c1096b97d29165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:41.653457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.654009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14681d4d-1a00-453c-aa30-5b96d5fa0b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:41.656176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1018/2059] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:41 2022] DELETE /identity/v3/projects/8edd0c96656e451db4c1096b97d29165 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:41.660990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.661274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.661550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.680990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:41.682193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:41.746106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1042/2060] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:41.753840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.754058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.754354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.774878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:41.776110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:41.784525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1019/2061] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:41.788758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.799075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df604-0f32-4c9b-b6f0-40d88dca50af None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.803616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.804258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.804536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.804804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.805556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:41.805859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.807472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:41.818643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1043/2062] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:41:41.822780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.832732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9de4-343d-4341-a253-b3cd2980e351 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.838031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.838646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.838926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.839199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.839836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.841797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:41.847030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:41.870250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1020/2063] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:41 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:41.874383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.884510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8defe7-4363-4b31-8a3c-bf8634ae9520 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.893648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:41.942241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.942842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.943123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.943394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.944004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.945936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:41.969609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1044/2064] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:41 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:41.972271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:41.982940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c22de3-b77b-4900-9571-f8315575b902 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:41.987652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:41.988321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:41.988608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:41.988879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:41.989516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:41.991131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.001130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1021/2065] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:42.005459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.015928 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5bcf4-c8ae-42d9-82ac-6c503da1d6aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.020561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.021158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.021435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.021705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.022338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.023906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342408ea-9889-4bd6-b608-a1baa7069591 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.035260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1045/2066] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:42.039496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.049620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87856c0b-984f-45b0-90e0-2680e8f47707 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.054298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.054945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.055251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.055523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] PATH_INFO: `/v3/projects/a0c3bda492ca4461b0f3c49d9284e0f3/users/3f3291f47ba3480fa4de2a960739e7ca/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.073549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c3bda492ca4461b0f3c49d9284e0f3, user_id=3f3291f47ba3480fa4de2a960739e7ca, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.076319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.090693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1022/2067] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:42 2022] PUT /identity/v3/projects/a0c3bda492ca4461b0f3c49d9284e0f3/users/3f3291f47ba3480fa4de2a960739e7ca/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:42.103178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c645-d645-4881-a487-b2db690c514e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.103463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c645-d645-4881-a487-b2db690c514e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.103735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c645-d645-4881-a487-b2db690c514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.142008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5784c645-d645-4881-a487-b2db690c514e None None] MFA Rules not processed for user `3f3291f47ba3480fa4de2a960739e7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:42.143405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5784c645-d645-4881-a487-b2db690c514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:42.223281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1046/2068] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:42.227631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.309231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de2e9-d48b-4316-b64a-b49a91781578 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.316809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.317547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.317928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.318296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.318986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.321812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.366180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1023/2069] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:42 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:42.370573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c645-d645-4881-a487-b2db690c514e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.385327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c645-d645-4881-a487-b2db690c514e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.463435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.464320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.464604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.464878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.465534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.467592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.494181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1047/2070] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:42 2022] POST /identity/v3/users => generated 309 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:42.495588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.506751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08570084-e5c3-4286-96ce-29597e3d6342 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.511487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.512030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.512349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.512622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.513290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.515450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.530105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1024/2071] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:42.534464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.544837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a566-2c5f-47ed-9137-cbddb5df0b33 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.557697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.558609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.558889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.559415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] PATH_INFO: `/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe/users/551614edb3c643f6ad0c86ccfca66013/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.571017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:42.578508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e542627f35f4e9c8d3a34b7a2cd95fe, user_id=551614edb3c643f6ad0c86ccfca66013, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.581869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.597738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1048/2072] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:42 2022] PUT /identity/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe/users/551614edb3c643f6ad0c86ccfca66013/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:42.601759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.612126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562bc39-2af7-43d3-a66e-34d045dc119a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.669084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.669696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.669976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.670251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.671419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.673034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523620db-48b5-44f0-830d-7849752ba0be admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.682651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1025/2073] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:42.687231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.698987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3fe4-2e76-4df6-a978-48599f83ca75 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.703967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.704669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.704952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.705229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] PATH_INFO: `/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe/users/551614edb3c643f6ad0c86ccfca66013/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.707146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e542627f35f4e9c8d3a34b7a2cd95fe, user_id=551614edb3c643f6ad0c86ccfca66013, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.709832 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.720644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1049/2074] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:42 2022] PUT /identity/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe/users/551614edb3c643f6ad0c86ccfca66013/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:42.731209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.731522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.731798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.761652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] MFA Rules not processed for user `551614edb3c643f6ad0c86ccfca66013`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:42.762812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:42.771072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:42.832101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1026/2075] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:42.842571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:42.844304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:42.901589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d261-c4cb-4c4f-a6f9-d0c1e91e5909 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:42.905689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:42.906292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:42.906565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:42.906828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:42.916030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:42.917474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e40f4-4544-4ca8-9b40-038f5eb7e1a0 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:42.927124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1050/2076] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:43.073305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:43.143710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58294-3228-442d-b02a-87dd86b5470a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:43.148301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:43.149026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:43.149313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:43.149586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] PATH_INFO: `/v3/users/3f3291f47ba3480fa4de2a960739e7ca` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:43.150718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3291f47ba3480fa4de2a960739e7ca)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:43.152748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:43.207795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3291f47ba3480fa4de2a960739e7ca'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.209033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3291f47ba3480fa4de2a960739e7ca'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.218671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3291f47ba3480fa4de2a960739e7ca'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.226956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3291f47ba3480fa4de2a960739e7ca'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.227738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3291f47ba3480fa4de2a960739e7ca'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.256984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1027/2077] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:43 2022] DELETE /identity/v3/users/3f3291f47ba3480fa4de2a960739e7ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:43.261521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:43.261803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:43.262067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:43.287352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:43.288634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:43.358822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1051/2078] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:43.368370 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:43.369816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:43.398969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:43.438761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae7fd9-c46c-47b1-9130-4c4978f252bd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:43.443153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:43.443763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:43.444038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:43.444333 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:43.455604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:43.457337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:43.468177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1028/2079] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:41:43.827611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:43.829380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:43.850226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ddb1-5345-4fee-b687-463b86830c2b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:43.862891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:43.863913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:43.864202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:43.864477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] PATH_INFO: `/v3/projects/a0c3bda492ca4461b0f3c49d9284e0f3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:43.865675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c3bda492ca4461b0f3c49d9284e0f3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:43.867567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:43.915309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c3bda492ca4461b0f3c49d9284e0f3', 'request_id': 'req-f80e8b28-c1c0-45f2-a561-11986fbd18a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.921303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c3bda492ca4461b0f3c49d9284e0f3', 'request_id': 'req-f80e8b28-c1c0-45f2-a561-11986fbd18a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.927431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c3bda492ca4461b0f3c49d9284e0f3', 'request_id': 'req-f80e8b28-c1c0-45f2-a561-11986fbd18a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.936736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:43.941227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] The token cache is being invalidate because project a0c3bda492ca4461b0f3c49d9284e0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:43.941685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.942404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:43.944281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1052/2080] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:43 2022] DELETE /identity/v3/projects/a0c3bda492ca4461b0f3c49d9284e0f3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:43.948345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:43.958371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1aa8-ab3c-4ed4-9130-1f607d0c8c74 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.013550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.014805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.015083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.015350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] PATH_INFO: `/v3/users/551614edb3c643f6ad0c86ccfca66013` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.016494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551614edb3c643f6ad0c86ccfca66013)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.018394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.063726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551614edb3c643f6ad0c86ccfca66013'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.064396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551614edb3c643f6ad0c86ccfca66013'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.072335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551614edb3c643f6ad0c86ccfca66013'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.079250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551614edb3c643f6ad0c86ccfca66013'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.079883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2cdbae9d-d484-4147-851e-a8c70961c4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551614edb3c643f6ad0c86ccfca66013'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.096805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1029/2081] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:43 2022] DELETE /identity/v3/users/551614edb3c643f6ad0c86ccfca66013 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:44.375651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.378539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:44.394282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8b28-c1c0-45f2-a561-11986fbd18a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.455828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.456504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.456779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.457195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] PATH_INFO: `/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.458350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e542627f35f4e9c8d3a34b7a2cd95fe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.461159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.521633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e542627f35f4e9c8d3a34b7a2cd95fe', 'request_id': 'req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.527629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e542627f35f4e9c8d3a34b7a2cd95fe', 'request_id': 'req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.534880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e542627f35f4e9c8d3a34b7a2cd95fe', 'request_id': 'req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.548515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] The token cache is being invalidate because project 8e542627f35f4e9c8d3a34b7a2cd95fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:44.548923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.549573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c22ec2f5-cf9b-4cf4-9aff-18340afdbd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:44.551035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1053/2082] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:44 2022] DELETE /identity/v3/projects/8e542627f35f4e9c8d3a34b7a2cd95fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:44.555935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.556273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.556552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.577349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:44.578576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:44.620693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:44.638560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1030/2083] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:44.646393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.646673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.646940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.667831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:44.669087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:44.677889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1054/2084] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:44.682142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.691797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d012c60-4937-4ca0-9291-0e385cf015d5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.696335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.696920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.697196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.697463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.698091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:44.698386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.699963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.711145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1031/2085] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:44.715197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.725102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e66ef-9e19-4004-be49-09bb4b30ca68 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.729743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.730339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.730622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.730898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.731515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.734022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.762888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1055/2086] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:44 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:44.767253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.776908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523bf26-a928-436d-adbe-0502b400fc4e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.840682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.841310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.841592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.841879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.843079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.845146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.868800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1032/2087] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:44 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:44.872701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.884663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f04ff-67d3-42dd-8fa3-fb8401922678 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.891267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.892185 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.892711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.893046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.893777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.895457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.907163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1056/2088] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:44.911114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.924429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd9e0-0e4b-4864-bb97-d62dd30799d1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.930403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.931139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.931526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.931905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.932835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:44.934664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e0645-f0f6-447b-bea6-281b10c8da88 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:44.949358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1033/2089] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:44.956701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:44.970175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e9c32-3e4b-410e-ae23-99e9f508b88a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:44.976262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:44.977303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:44.977303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:44.977477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] PATH_INFO: `/v3/projects/2acc243e9ff2476589becb28823a64eb/users/75ee558080654f35b93efacc96e0702e/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:44.997728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acc243e9ff2476589becb28823a64eb, user_id=75ee558080654f35b93efacc96e0702e, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.000603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.015776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1057/2090] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:44 2022] PUT /identity/v3/projects/2acc243e9ff2476589becb28823a64eb/users/75ee558080654f35b93efacc96e0702e/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:45.027772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.028180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.028521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.060364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] MFA Rules not processed for user `75ee558080654f35b93efacc96e0702e`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:45.061594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:45.124591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1034/2091] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:45.129252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.159070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:45.193356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93625-fda4-4baa-ad3b-2bb327ef7ba5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.198186 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.198916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.199331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.199659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.200471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.203486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.229828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1058/2092] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:45 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:45.234552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.245195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf96a-d139-4abc-aa61-a8c8567620b9 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.285622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:45.303062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.303657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.303934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.304251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.304870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.306785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.327671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1035/2093] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:45 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:45.331730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.342930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897f7e5-1382-4da3-8877-ab04252bf94d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.347621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.348268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.348550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.348849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.349494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.351100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.362253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1059/2094] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:45.366526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.376554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3452d-9e49-4db2-af97-2026e63b3938 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.381316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.381952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.382230 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.382501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] PATH_INFO: `/v3/projects/eea758bb0c5641acb360826954de25b0/users/b70c09731d3f47b391ab641db26e63a5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.397103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea758bb0c5641acb360826954de25b0, user_id=b70c09731d3f47b391ab641db26e63a5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.399764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.414500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1036/2095] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:45 2022] PUT /identity/v3/projects/eea758bb0c5641acb360826954de25b0/users/b70c09731d3f47b391ab641db26e63a5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:45.418578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.429347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2eb0a-95f3-4b06-a334-b354edf6bc28 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.486449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.487111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.487506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.487789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.488480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.490075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b6c3-d1ce-49f3-9577-51d5d4c1cd9c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.499753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1060/2096] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:41:45.504454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.514662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c56bc1-5fda-4ae4-a29e-371f1947fa5e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.520537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.521211 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.521493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.521768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] PATH_INFO: `/v3/projects/eea758bb0c5641acb360826954de25b0/users/b70c09731d3f47b391ab641db26e63a5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.523695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea758bb0c5641acb360826954de25b0, user_id=b70c09731d3f47b391ab641db26e63a5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.526549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.538176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1037/2097] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:45 2022] PUT /identity/v3/projects/eea758bb0c5641acb360826954de25b0/users/b70c09731d3f47b391ab641db26e63a5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:45.549002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.549290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.549564 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.578789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] MFA Rules not processed for user `b70c09731d3f47b391ab641db26e63a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:45.580023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:45.654315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1061/2098] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:45.662400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:45.664146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:45.724027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef635f-08b3-4b6c-b557-2bffad871029 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:45.727748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:45.728384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:45.728665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:45.728934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:45.738271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:45.739739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf0fb9-abbe-4900-b18e-e902fcfa0093 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:45.749173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1038/2099] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:46.176274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:46.207026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:46.249627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d5b9e-28a6-4bcf-910d-667d00401533 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:46.257961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:46.258599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:46.258883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:46.259159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] PATH_INFO: `/v3/users/75ee558080654f35b93efacc96e0702e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:46.260324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ee558080654f35b93efacc96e0702e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:46.262292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:46.310069 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ee558080654f35b93efacc96e0702e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:46.310734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ee558080654f35b93efacc96e0702e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:46.323641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ee558080654f35b93efacc96e0702e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:46.324385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ee558080654f35b93efacc96e0702e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:46.333779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ee558080654f35b93efacc96e0702e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:46.346602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1062/2100] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:46 2022] DELETE /identity/v3/users/75ee558080654f35b93efacc96e0702e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:46.352041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:46.352515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:46.353330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:46.373264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:46.375054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:46.439887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1039/2101] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:46.449639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:46.451051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:46.510631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba76b97-43a4-4ca9-97be-3aa99409fc4a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:46.514243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:46.515024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:46.515439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:46.515714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:46.525356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:46.526780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:46.536431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1063/2102] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:47.029330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:47.032273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:47.047821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13badc-1f58-48e8-bead-428422bb6f0b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:47.052903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:47.053536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.053814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.054079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] PATH_INFO: `/v3/projects/2acc243e9ff2476589becb28823a64eb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.055292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acc243e9ff2476589becb28823a64eb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:47.057161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:47.097280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:47.110016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acc243e9ff2476589becb28823a64eb', 'request_id': 'req-f6a002b2-1f51-4b15-81b4-3edef06a3b31'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.115387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acc243e9ff2476589becb28823a64eb', 'request_id': 'req-f6a002b2-1f51-4b15-81b4-3edef06a3b31'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.123335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acc243e9ff2476589becb28823a64eb', 'request_id': 'req-f6a002b2-1f51-4b15-81b4-3edef06a3b31'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.134950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] The token cache is being invalidate because project 2acc243e9ff2476589becb28823a64eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:47.135232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.135876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.137378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1040/2103] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:47 2022] DELETE /identity/v3/projects/2acc243e9ff2476589becb28823a64eb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:47.142008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:47.151268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939ea90-4a55-4978-8317-0a08ae3cb754 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:47.193862 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:47.211907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:47.212504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.212780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.213054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] PATH_INFO: `/v3/users/b70c09731d3f47b391ab641db26e63a5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.214536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70c09731d3f47b391ab641db26e63a5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:47.216358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:47.298528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70c09731d3f47b391ab641db26e63a5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.302613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70c09731d3f47b391ab641db26e63a5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.328125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70c09731d3f47b391ab641db26e63a5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.329025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70c09731d3f47b391ab641db26e63a5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.359410 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-22db6953-3de0-4abd-a08a-10ca68ca968b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70c09731d3f47b391ab641db26e63a5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.375566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1064/2104] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:41:47 2022] DELETE /identity/v3/users/b70c09731d3f47b391ab641db26e63a5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:47.655982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:47.657572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:47.671089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a002b2-1f51-4b15-81b4-3edef06a3b31 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:47.733415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:47.733981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.734261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.734558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] PATH_INFO: `/v3/projects/eea758bb0c5641acb360826954de25b0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.735641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea758bb0c5641acb360826954de25b0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:47.737624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:47.789764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea758bb0c5641acb360826954de25b0', 'request_id': 'req-723bd951-a481-440d-82c3-1898e3c96d27'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.796182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea758bb0c5641acb360826954de25b0', 'request_id': 'req-723bd951-a481-440d-82c3-1898e3c96d27'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.803714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea758bb0c5641acb360826954de25b0', 'request_id': 'req-723bd951-a481-440d-82c3-1898e3c96d27'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.816203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] The token cache is being invalidate because project eea758bb0c5641acb360826954de25b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:41:47.816541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.817663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-723bd951-a481-440d-82c3-1898e3c96d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:41:47.820381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1041/2105] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:41:47 2022] DELETE /identity/v3/projects/eea758bb0c5641acb360826954de25b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:47.826303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.826591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.826865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.847489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:47.848775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:47.918050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1065/2106] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:47.922233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.922575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.922851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.947652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:47.949287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:47.958825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1042/2107] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:47.962993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:47.973198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c0083-f2a6-4f52-a66a-e25d0278455d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:47.977930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:47.978540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:47.978816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:47.979104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:47.979749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:41:47.980084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:47.981677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:47.994000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1066/2108] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:41:47.999144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.009722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417aad3-ed1c-41e3-b7e7-51354a0c2f99 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.014981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.015654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.015954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.016272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.016901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.018828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.050553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1043/2109] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:41:47 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:41:48.051615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.064471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5654c9f-5bc2-4c07-8e59-6ca27a49b7aa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.112216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:48.138467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.139703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.140135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.140477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.141178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.143163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.165942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1067/2110] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:41:48 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:41:48.170098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.181724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b69ac-597a-429d-818c-51116dd35047 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.187976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.188643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.188927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.189353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.189998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.191592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.209754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1044/2111] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:48.211304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.221786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40567e-678a-44be-b688-0316f1efd408 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.226773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.227407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.227698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.227972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.228666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.230296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5eb1-0f57-400a-8486-d606a85b7bda admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.243435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1068/2112] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:41:48.245955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.256899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb94b-a0aa-40fc-b95a-90a7b3820f47 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.261567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.262213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.262511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.262769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] PATH_INFO: `/v3/projects/7060066f09e6499884bea18898e3fa44/users/589888a7241f489aa773a54603601824/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.271649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:41:48.279198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7060066f09e6499884bea18898e3fa44, user_id=589888a7241f489aa773a54603601824, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.282310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.296100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1045/2113] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:41:48 2022] PUT /identity/v3/projects/7060066f09e6499884bea18898e3fa44/users/589888a7241f489aa773a54603601824/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:41:48.306475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cfb0-e32e-4c8e-8be1-23aedb7bafa7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.306783 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cfb0-e32e-4c8e-8be1-23aedb7bafa7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.307050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cfb0-e32e-4c8e-8be1-23aedb7bafa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.335915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e270cfb0-e32e-4c8e-8be1-23aedb7bafa7 None None] MFA Rules not processed for user `589888a7241f489aa773a54603601824`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:48.337179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e270cfb0-e32e-4c8e-8be1-23aedb7bafa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:48.403975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1069/2114] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:41:48.415494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.418728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:48.498185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1381-4ee5-4f6f-b6ae-9074f95db855 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.503007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.503712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.504084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.504509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.513737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.515836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.526147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1046/2115] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:41:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:41:48.597413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f57b-2116-4f0b-be4d-7a66de8f2a94 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.597703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f57b-2116-4f0b-be4d-7a66de8f2a94 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.597979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f57b-2116-4f0b-be4d-7a66de8f2a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.620281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2b83f57b-2116-4f0b-be4d-7a66de8f2a94 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:48.621601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b83f57b-2116-4f0b-be4d-7a66de8f2a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:48.689081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1070/2116] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:48.709335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:48.711330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:48.828993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a73e1-8348-4d72-92fb-2c44ed3acab7 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:48.835224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:48.835856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:48.836158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:48.836430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:48.846754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:48.848469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:48.858569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1047/2117] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:41:49.607475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be55df-4382-421e-8a81-10107d0f8ed0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:49.608485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be55df-4382-421e-8a81-10107d0f8ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:49.608695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be55df-4382-421e-8a81-10107d0f8ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:49.628958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-97be55df-4382-421e-8a81-10107d0f8ed0 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:49.630233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97be55df-4382-421e-8a81-10107d0f8ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:49.637513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1071/2118] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:49.651314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:49.663173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b207f-f829-4643-9d24-cb49f91b1643 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:49.668138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:49.668723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:49.668996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:49.669282 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:49.677075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:49.678630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:49.686861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1048/2119] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:41:49.923469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38576-e369-4238-a005-669765cfe757 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:49.923758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38576-e369-4238-a005-669765cfe757 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:49.924042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38576-e369-4238-a005-669765cfe757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:49.943535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-49e38576-e369-4238-a005-669765cfe757 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:49.944806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-49e38576-e369-4238-a005-669765cfe757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:49.952395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1072/2120] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:49.964034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:49.975558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de90a7-e03d-4218-8b44-cea3d02bba3c service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:49.980728 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:49.981352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:49.981626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:49.981892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:49.990123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:49.991685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:50.000877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1049/2121] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:41:57.898266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:57.898765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:57.898867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:57.917922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:41:57.919132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:41:57.928327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1073/2122] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:41:57.941445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:41:57.953080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742214-3551-4c78-8be7-49285db7fcdf service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:41:57.958491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:41:57.959162 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:41:57.959448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:41:57.959727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:41:57.968368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:41:57.969955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a29c0e-d54d-457b-81b4-1cc109a34650 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:41:57.978218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1050/2123] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:42:00.123993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:00.125461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:00.172281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:00.191982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a675d47-b7fb-43f1-a550-3bf42a7ea0f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:00.196531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:00.197132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:00.197409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:00.197703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] PATH_INFO: `/v3/users/06a36df93eeb408d80edcd75c2f8e5aa` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:00.198827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a36df93eeb408d80edcd75c2f8e5aa)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:00.200891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:00.246272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a36df93eeb408d80edcd75c2f8e5aa'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.247011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a36df93eeb408d80edcd75c2f8e5aa'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.260779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a36df93eeb408d80edcd75c2f8e5aa'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.261863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a36df93eeb408d80edcd75c2f8e5aa'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.273311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a36df93eeb408d80edcd75c2f8e5aa'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.285985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1074/2124] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:00 2022] DELETE /identity/v3/users/06a36df93eeb408d80edcd75c2f8e5aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:00.290453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:00.290907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:00.290998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:00.309562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:00.310842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:00.344740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:00.371563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1051/2125] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:00.381931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:00.383314 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:00.444540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c631d-395f-4c09-b19f-9c30908d2b7f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:00.448493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:00.449123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:00.449405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:00.449705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:00.458993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:00.463173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:00.471233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1075/2126] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:00.641112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:00.642552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:00.657559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb24dc-ca38-4c44-af45-beb87567eb9f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:00.659692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:00.660511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:00.660790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:00.661060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] PATH_INFO: `/v3/projects/ea098ecb235a466d850acbc60c3e54b0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:00.662185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea098ecb235a466d850acbc60c3e54b0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:00.664134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:00.711284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea098ecb235a466d850acbc60c3e54b0', 'request_id': 'req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.716737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea098ecb235a466d850acbc60c3e54b0', 'request_id': 'req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.724213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea098ecb235a466d850acbc60c3e54b0', 'request_id': 'req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.736092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] The token cache is being invalidate because project ea098ecb235a466d850acbc60c3e54b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:00.736374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.737035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f5018c74-474c-4305-bfc7-b39b6dbd0ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:00.739116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1052/2127] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:00 2022] DELETE /identity/v3/projects/ea098ecb235a466d850acbc60c3e54b0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:10.466649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:10.733221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:12.272581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:12.274198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:12.287513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f233-b710-473f-8916-c0b279fe2e92 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:12.344418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:12.344972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:12.345252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:12.345525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] PATH_INFO: `/v3/users/4ce914d787414156bd330d6082d2bfd4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:12.346778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce914d787414156bd330d6082d2bfd4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:12.349392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:12.398257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce914d787414156bd330d6082d2bfd4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:12.398941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce914d787414156bd330d6082d2bfd4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:12.412879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce914d787414156bd330d6082d2bfd4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:12.413555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce914d787414156bd330d6082d2bfd4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:12.421006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce914d787414156bd330d6082d2bfd4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:12.433063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1076/2128] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:12 2022] DELETE /identity/v3/users/4ce914d787414156bd330d6082d2bfd4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:12.437437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:12.437926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:12.438024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:12.456396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:12.457643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:12.515847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1053/2129] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:12.526056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:12.527483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:12.592033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a45b-2473-41a3-96dc-01953b37549f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:12.596370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:12.596981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:12.597271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:12.597550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:12.607273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:12.608746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645f13-c4d6-4f16-99c3-79dbdd5d8b4e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:12.618176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1077/2130] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:12.975135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:12.976585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:12.990189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38a649-0d61-4a96-8f6c-de9f367b225d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:12.994944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:12.995573 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:12.995879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:12.996180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] PATH_INFO: `/v3/projects/62442419687c41489ef2922d8c98afbc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:12.997320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62442419687c41489ef2922d8c98afbc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:12.999233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.048119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62442419687c41489ef2922d8c98afbc', 'request_id': 'req-11d9d058-7bff-4359-8a0c-5fba2c9c210b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.053397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62442419687c41489ef2922d8c98afbc', 'request_id': 'req-11d9d058-7bff-4359-8a0c-5fba2c9c210b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.061172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62442419687c41489ef2922d8c98afbc', 'request_id': 'req-11d9d058-7bff-4359-8a0c-5fba2c9c210b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.072669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] The token cache is being invalidate because project 62442419687c41489ef2922d8c98afbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:13.072960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.073585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-11d9d058-7bff-4359-8a0c-5fba2c9c210b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.075076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1054/2131] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:12 2022] DELETE /identity/v3/projects/62442419687c41489ef2922d8c98afbc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:13.081023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.081383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.081570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.101560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:13.102753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:13.119630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:13.170165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1078/2132] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:13.178195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.178476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.178743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.199338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:13.200716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:13.209701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1055/2133] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:13.214157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.223788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcde45-247e-44ea-9d40-63247b047c79 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.228623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.229258 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.229523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.229794 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.230445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:42:13.230749 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.232390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.244849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1079/2134] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:42:13.249141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.259188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ee0e6-69cc-4cb7-826e-daf8bada88ce None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.263857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.264472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.264754 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.265027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.265641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.267523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.296723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1056/2135] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:42:13.300828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.311317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb07e-96f1-450b-8f85-68c701a4bd66 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.367063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.367677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.367960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.368277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.368915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.370917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.394308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1080/2136] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:13.398527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.411223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee795-d3d6-484f-9f6e-0248b1117907 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.415999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.416629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.416911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.417186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.417826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.419420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.430057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1057/2137] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:13.434249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.444724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bc84a-4c84-48ca-9446-95b393861fe6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.449611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.450199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.450479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.450751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.451388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.453008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7d1dc-f5f7-4f59-a866-3c20074a70b2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.463812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1081/2138] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:13.468198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.478893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81dbc-e4fa-4d50-8917-b7ba33cafb93 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.483543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.484264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.484548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.484825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] PATH_INFO: `/v3/projects/e766c429f54f4efc8e31187f321c5893/users/1f4251d5aad24f448fb3846e560d398f/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.499718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e766c429f54f4efc8e31187f321c5893, user_id=1f4251d5aad24f448fb3846e560d398f, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.502402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.517364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1058/2139] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:13 2022] PUT /identity/v3/projects/e766c429f54f4efc8e31187f321c5893/users/1f4251d5aad24f448fb3846e560d398f/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:13.527479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.527758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.528024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.559247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] MFA Rules not processed for user `1f4251d5aad24f448fb3846e560d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:13.560568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:13.628428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1082/2140] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:13.639617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.641360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:13.665094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:13.701522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a40c87-1332-4cb5-9cb1-5f8a0bfa6033 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.705588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.706409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.706700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.707099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.716647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.718099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ea0d8-acc0-4def-a5ec-408676254fd4 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.728453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1059/2141] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:13.754210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:13.773076 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:13.819919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f376903-68dd-4ee0-8614-ca6b789d3ec6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:13.824544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:13.825178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.825453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.826057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] PATH_INFO: `/v3/users/1f4251d5aad24f448fb3846e560d398f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.826954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4251d5aad24f448fb3846e560d398f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:13.828898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:13.886702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4251d5aad24f448fb3846e560d398f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.887460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4251d5aad24f448fb3846e560d398f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.901132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4251d5aad24f448fb3846e560d398f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.902248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4251d5aad24f448fb3846e560d398f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.913905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4251d5aad24f448fb3846e560d398f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:13.928340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1083/2142] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:13 2022] DELETE /identity/v3/users/1f4251d5aad24f448fb3846e560d398f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:13.933019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:13.933414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:13.933972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:13.959621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:13.961022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:14.030246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1060/2143] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:14.040863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.042286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:14.126822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b32175-4773-49f0-90aa-bf76097b9863 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.131414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.131956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.132282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.132555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.141988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.143421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322186f-9c86-4ba1-ba93-f4356f52843f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.153275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1084/2144] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:14.422826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.425771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:14.441497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f50c1-0728-48e8-b22e-d0e498bcac07 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.447085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.447727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.447995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.448297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] PATH_INFO: `/v3/projects/e766c429f54f4efc8e31187f321c5893` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.449755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e766c429f54f4efc8e31187f321c5893)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.451594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.498779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e766c429f54f4efc8e31187f321c5893', 'request_id': 'req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:14.504541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e766c429f54f4efc8e31187f321c5893', 'request_id': 'req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:14.512461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e766c429f54f4efc8e31187f321c5893', 'request_id': 'req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:14.523337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] The token cache is being invalidate because project e766c429f54f4efc8e31187f321c5893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:14.523604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:14.524239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5f6d13dd-6de9-4faf-8c1e-f0887e136eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:14.525700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1061/2145] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:14 2022] DELETE /identity/v3/projects/e766c429f54f4efc8e31187f321c5893 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:14.530473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.530948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.531055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.550487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:14.551775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:14.586651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:14.615182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1085/2146] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:42:14.623509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.623796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.624102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.644264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:14.645475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:14.653816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1062/2147] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:14.658077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.668458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1ac6f-d34c-4c10-973f-8f97b39ce32e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.672952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.673543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.673826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.674099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.674742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:42:14.675044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.676717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.689038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1086/2148] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:42:14.693253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.702325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc839b-7567-4c18-b0e6-b5207d5282c0 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.707024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.707606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.707882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.708693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.709305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.711181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.738422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1063/2149] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:42:14 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:14.742545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.752706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaaa14-88f0-41a9-b5dc-2f58732a92c8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.809656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.810279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.810562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.810837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.812323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.814286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.839859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1087/2150] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:42:14 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:14.841026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.852099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943628-3f40-4c25-85f4-f585f3ef1650 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.857016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.857625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.857932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.858167 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.858829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.860451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.870747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1064/2151] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:42:14.874907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.886034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fb66c-c89f-4e12-a273-725078b78639 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.890754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.891379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.891652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.891921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.892581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.894163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc9b5-4313-4eee-a8f1-dbc09449df90 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.905391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1088/2152] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:14.909713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:14.920767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512a4f-308d-478b-869d-de67d19edbb4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:14.925397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:14.926047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.926320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.926586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] PATH_INFO: `/v3/projects/f31d8cf383c745469523a69a7c5f6f24/users/ade3ef60afe14d91b00737a394c56516/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:14.929175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:14.943823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31d8cf383c745469523a69a7c5f6f24, user_id=ade3ef60afe14d91b00737a394c56516, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:14.946611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:14.961929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1065/2153] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:14 2022] PUT /identity/v3/projects/f31d8cf383c745469523a69a7c5f6f24/users/ade3ef60afe14d91b00737a394c56516/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:14.972214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb5ff-6070-4081-a179-f7fdc30ffbf7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:14.972530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb5ff-6070-4081-a179-f7fdc30ffbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:14.972802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eb5ff-6070-4081-a179-f7fdc30ffbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:15.004921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-438eb5ff-6070-4081-a179-f7fdc30ffbf7 None None] MFA Rules not processed for user `ade3ef60afe14d91b00737a394c56516`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:15.006694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-438eb5ff-6070-4081-a179-f7fdc30ffbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:15.071240 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1089/2154] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:15.084524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:15.086237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:15.143642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd840-6e84-40a9-ad28-7eaad8e98312 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:15.148468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:15.149131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:15.149408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:15.149677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:15.158375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:15.159846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:15.168620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1066/2155] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:19.070317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:19.070800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:19.071017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:19.090887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:19.092120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:19.128850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:19.162901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1090/2156] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:19.185708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:19.187119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:19.260673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1c15-9cc5-42b6-afa3-1209f7086a3c service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:19.266285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:19.266877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:19.267151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:19.267419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:19.275793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:19.277389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1bee6-4d13-4e98-80f4-36c042fa7bb0 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:19.286525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1067/2157] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:20.206607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:20.217793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a44cd-3ae6-4982-a46f-e63095fb00ce None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:20.222283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:20.222936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:20.223196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:20.223464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] PATH_INFO: `/v3/users/ade3ef60afe14d91b00737a394c56516` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:20.224613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade3ef60afe14d91b00737a394c56516)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:20.226526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:20.274054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade3ef60afe14d91b00737a394c56516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.274742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade3ef60afe14d91b00737a394c56516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.298045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade3ef60afe14d91b00737a394c56516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.298770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade3ef60afe14d91b00737a394c56516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.306322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade3ef60afe14d91b00737a394c56516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.319366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1091/2158] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:20 2022] DELETE /identity/v3/users/ade3ef60afe14d91b00737a394c56516 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:20.324184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:20.324663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:20.324757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:20.345420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:20.346684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:20.408329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1068/2159] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:20.419489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:20.421044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:20.482617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385561-8851-4414-b15e-a01d5e394b23 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:20.486424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:20.487035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:20.487316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:20.487589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:20.498032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:20.499663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff6cf-1fd1-4071-9614-f21044c49200 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:20.511550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1092/2160] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:20.861357 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:20.862864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:20.886989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddca4bf-a322-41cd-b938-12a84066b7ed None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:20.892347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:20.892987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:20.893267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:20.893537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] PATH_INFO: `/v3/projects/f31d8cf383c745469523a69a7c5f6f24` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:20.894636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31d8cf383c745469523a69a7c5f6f24)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:20.896590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:20.903277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:20.945583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31d8cf383c745469523a69a7c5f6f24', 'request_id': 'req-aa2265e1-c474-4de1-9f41-b58820c0a69a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.951191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31d8cf383c745469523a69a7c5f6f24', 'request_id': 'req-aa2265e1-c474-4de1-9f41-b58820c0a69a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.957767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31d8cf383c745469523a69a7c5f6f24', 'request_id': 'req-aa2265e1-c474-4de1-9f41-b58820c0a69a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.969233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] The token cache is being invalidate because project f31d8cf383c745469523a69a7c5f6f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:20.969520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.970163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:20.971727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1069/2161] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:20 2022] DELETE /identity/v3/projects/f31d8cf383c745469523a69a7c5f6f24 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:23.125728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6af84-3b0e-43c4-b5ac-c034b046de4d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:23.126225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6af84-3b0e-43c4-b5ac-c034b046de4d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:23.126319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6af84-3b0e-43c4-b5ac-c034b046de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:23.149639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05c6af84-3b0e-43c4-b5ac-c034b046de4d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:23.152975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05c6af84-3b0e-43c4-b5ac-c034b046de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:23.224048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:23.242422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1093/2162] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:23.374173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:23.375628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:23.456505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2265e1-c474-4de1-9f41-b58820c0a69a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:23.462454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:23.463070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:23.463351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:23.463625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:23.472362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:23.474293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6a643-f84d-41d1-9cb8-418fa902e067 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:23.483773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1070/2163] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:25.962838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:25.963320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:25.963412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:25.982461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] MFA Rules not processed for user `229ab54ddaee45dabf1c38d5d049528d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:25.983801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:26.041277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1094/2164] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:27.450518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:27.451057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:27.451188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:27.473816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:27.475093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:27.483613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1071/2165] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:42:27.506321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:27.521124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118db655-7923-41ec-bda8-a573bbf2acef None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:27.526616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:27.527724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:27.527998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:27.528312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:27.536353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:27.537910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5a192-97f9-4474-80c0-225d983fab9e service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:27.547677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1095/2166] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:29.640567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:29.642183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:29.654954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe75fd0-7772-43c1-820b-6270dba554df None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:29.659980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:29.660701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:29.661135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:29.661486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] PATH_INFO: `/v3/users/589888a7241f489aa773a54603601824` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:29.662655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] RBAC: Authorizing `identity:delete_user(user_id=589888a7241f489aa773a54603601824)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:29.666526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:29.736281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589888a7241f489aa773a54603601824'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:29.736956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589888a7241f489aa773a54603601824'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:29.744563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589888a7241f489aa773a54603601824'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:29.751643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589888a7241f489aa773a54603601824'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:29.752352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589888a7241f489aa773a54603601824'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:29.757072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:29.773606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1072/2167] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:29 2022] DELETE /identity/v3/users/589888a7241f489aa773a54603601824 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:29.778355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:29.778954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:29.778954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:29.799464 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:29.800835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:29.863095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1096/2168] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:29.875817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:29.877353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:29.946290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceb9a8-bd8a-44a4-ac5f-dd1b3bcd972c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:29.951034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:29.951640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:29.951918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:29.952233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:29.962551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:29.963987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ffe9-5189-4ca0-b1b3-44cf48a1cdf9 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:29.974872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1073/2169] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:30.266456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.268529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:30.291780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd682795-e8f6-4622-bf9a-fdaef3c8a37d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.308594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.309262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.309539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.309964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] PATH_INFO: `/v3/projects/7060066f09e6499884bea18898e3fa44` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.312689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7060066f09e6499884bea18898e3fa44)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.314692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.382189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7060066f09e6499884bea18898e3fa44', 'request_id': 'req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:30.389123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7060066f09e6499884bea18898e3fa44', 'request_id': 'req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:30.395582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7060066f09e6499884bea18898e3fa44', 'request_id': 'req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:30.409830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] The token cache is being invalidate because project 7060066f09e6499884bea18898e3fa44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:30.410110 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:30.410897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f39ca3f-0321-4710-a9e1-f3bc8b2d0f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:30.412513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1097/2170] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:30 2022] DELETE /identity/v3/projects/7060066f09e6499884bea18898e3fa44 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:30.418395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.418686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.418957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.439757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:30.440986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:30.505376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1074/2171] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:42:30.514818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.515106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.515377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.530495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:30.536568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:30.547213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:30.565698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1098/2172] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:30.569768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.580298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47036df3-5905-4e89-b1e8-1123f7fb674a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.585450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.586056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.586339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.586617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.587290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:42:30.587593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.589231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.601753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1075/2173] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:42:30.606123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.615805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b398c-9834-44e6-a04d-6289e7db17a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.620420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.621083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.621358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.621625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.622248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.624139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.657944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1099/2174] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:42:30 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:30.659083 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.669745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ecc30-67e0-45d7-8d50-c9e8c9a3b399 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.745063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.745790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.746342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.746595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.747106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.749402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.772643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1076/2175] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:42:30 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:30.776725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.787854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b06d4-3189-44ac-a070-24466e37e509 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.794290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.795187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.795453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.795720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.796576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.798347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.810170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1100/2176] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:30.814166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.820751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:30.826056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bd94f-1909-4094-b1e7-ac13d0169b5c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.836226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.836873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.837152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.837433 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.838215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.840578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b13491-3d15-48e2-8c3b-bdbdc1ea5f73 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.851681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1077/2177] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:30.855795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:30.865743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0568d8-305d-4d59-8ee7-f599be7c2231 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:30.870354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:30.871031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.871307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.871745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] PATH_INFO: `/v3/projects/7c75a79584fd4c9c97325f6287893298/users/6a47288dd55a44b0a870c4d5538af86c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.887000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c75a79584fd4c9c97325f6287893298, user_id=6a47288dd55a44b0a870c4d5538af86c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:30.889934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:30.904305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1101/2178] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:30 2022] PUT /identity/v3/projects/7c75a79584fd4c9c97325f6287893298/users/6a47288dd55a44b0a870c4d5538af86c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:30.914474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b78a6-7e0b-400a-a82a-c7fdcd960054 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:30.914871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b78a6-7e0b-400a-a82a-c7fdcd960054 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:30.915046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b78a6-7e0b-400a-a82a-c7fdcd960054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:30.946296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-711b78a6-7e0b-400a-a82a-c7fdcd960054 None None] MFA Rules not processed for user `6a47288dd55a44b0a870c4d5538af86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:30.947691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-711b78a6-7e0b-400a-a82a-c7fdcd960054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:31.021743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1078/2179] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:31.033063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:31.034904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:31.091854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72edba-45ca-474e-9d2d-36d32a502627 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:31.095495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:31.096133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:31.096418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:31.096691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:31.104918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:31.106957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:31.115744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1102/2180] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:31.620874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff858-a444-496c-a8e5-4cdb78e62857 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:31.621432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff858-a444-496c-a8e5-4cdb78e62857 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:31.621717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff858-a444-496c-a8e5-4cdb78e62857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:31.642302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b83ff858-a444-496c-a8e5-4cdb78e62857 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:31.643630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b83ff858-a444-496c-a8e5-4cdb78e62857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:31.707737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1079/2181] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:31.726747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:31.728241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:31.801378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086d33-cc58-47a0-95dc-026e2839d668 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:31.806836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:31.807476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:31.807735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:31.808000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:31.816499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:31.818057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:31.827810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1103/2182] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:35.740045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18767-323c-4a35-b3ae-247012ab49cd None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:35.740562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18767-323c-4a35-b3ae-247012ab49cd None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:35.740791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c18767-323c-4a35-b3ae-247012ab49cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:35.761975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a8c18767-323c-4a35-b3ae-247012ab49cd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:35.763196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a8c18767-323c-4a35-b3ae-247012ab49cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:35.771319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1080/2183] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:35.785789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:35.796912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a548806-fce0-4ea2-a8b6-333fc8615ea0 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:35.802617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:35.803217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:35.803497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:35.803768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:35.812665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:35.814235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:35.823626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1104/2184] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:38.951640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:38.952698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:38.953238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:38.974765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:38.976214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:38.984892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1081/2185] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:39.011828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:39.024683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa465d-7db1-45f3-8f5b-0290a2da3dc0 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:39.030742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:39.031336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:39.031616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:39.031887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:39.040438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:39.041998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dfedf-4ce5-4f4c-a8b8-7812975c2196 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:39.054090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1105/2186] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:41.365449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:41.375701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1adda7-7ac8-4ff9-8540-0fb0ebcc3835 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:41.381466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:41.383722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:41.384159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:41.384604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] PATH_INFO: `/v3/users/6a47288dd55a44b0a870c4d5538af86c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:41.386466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a47288dd55a44b0a870c4d5538af86c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:41.389094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:41.447737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a47288dd55a44b0a870c4d5538af86c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:41.448454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a47288dd55a44b0a870c4d5538af86c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:41.461219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a47288dd55a44b0a870c4d5538af86c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:41.470718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a47288dd55a44b0a870c4d5538af86c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:41.471472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a47288dd55a44b0a870c4d5538af86c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:41.475105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:41.505846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1082/2187] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:42:41 2022] DELETE /identity/v3/users/6a47288dd55a44b0a870c4d5538af86c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:41.511637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:41.512545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:41.513030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:41.522083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:41.535050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:41.537052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:41.611843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1106/2188] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:41.621505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:41.622932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:41.680377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaccd22-625b-4264-9f1f-398a91278729 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:41.684051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:41.684678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:41.684956 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:41.685558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:41.694135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:41.695559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd337-b5c5-45f3-acb4-91f2d96d0471 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:41.706796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1083/2189] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:42.007000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.009153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:42.027511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1f44-f7db-4f92-ae3b-2725c41aaf67 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.035722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.036405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.036688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.036958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] PATH_INFO: `/v3/projects/7c75a79584fd4c9c97325f6287893298` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.038097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c75a79584fd4c9c97325f6287893298)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.040147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.094035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c75a79584fd4c9c97325f6287893298', 'request_id': 'req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:42.099470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c75a79584fd4c9c97325f6287893298', 'request_id': 'req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:42.105631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c75a79584fd4c9c97325f6287893298', 'request_id': 'req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:42.118434 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] The token cache is being invalidate because project 7c75a79584fd4c9c97325f6287893298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:42:42.118908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:42.119538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2d937ef-7df3-4a0a-a10d-a350a934d1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:42:42.121093 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1107/2190] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:42:42 2022] DELETE /identity/v3/projects/7c75a79584fd4c9c97325f6287893298 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:42.126122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.126486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.126826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.148026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:42.149392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:42.210747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1084/2191] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:42.219563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.219887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.220515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.241384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:42.242672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:42.251786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1108/2192] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:42.256468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.266654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9205c6-cd28-4590-aa79-43659c6e0446 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.271753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.272402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.272687 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.272958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.273737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:42:42.274046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.275671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.293711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1085/2193] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:42:42.294845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.303854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57aec8-84a9-450e-9788-83953f32414b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.309278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.309804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.310079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.310341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.310950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.312852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.340151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1109/2194] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:42:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:42.344199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.354344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df3776-a3a7-41c4-bf6e-178b6258aacd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.425789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.426416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.426672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.426945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.427570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.429687 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.452952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1086/2195] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:42:42 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:42.457288 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.468277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e388-8615-423a-8dfe-785aca46b548 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.473758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.474465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.474745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.475278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.475957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.477954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.491472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1110/2196] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:42:42.495345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.511292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:42.533429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f3a8-68de-446e-b4f4-5ebfbf3a3394 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.540772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.541508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.541865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.542270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.543513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.545418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789172-35e0-4faa-b323-da882b7f7899 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.565861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1087/2197] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:42.567287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.584436 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e137c5-1266-49ad-99a2-f90862eb40cd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.608959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.608959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.608959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.608959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] PATH_INFO: `/v3/projects/ff8b3642f5c847a6955f698566d3ad05/users/af4d2d130fb6491e95176364bcdb0833/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.630730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8b3642f5c847a6955f698566d3ad05, user_id=af4d2d130fb6491e95176364bcdb0833, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.633686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.661443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1111/2198] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:42 2022] PUT /identity/v3/projects/ff8b3642f5c847a6955f698566d3ad05/users/af4d2d130fb6491e95176364bcdb0833/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:42.666503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321001-65bb-424d-9379-82f86bd750e1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.666787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321001-65bb-424d-9379-82f86bd750e1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.667062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321001-65bb-424d-9379-82f86bd750e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.687980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-35321001-65bb-424d-9379-82f86bd750e1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:42.690094 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-35321001-65bb-424d-9379-82f86bd750e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:42.768123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1088/2199] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:42:42.781337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:42.783605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:42.819354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:42.857016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930712b4-cb12-40b4-b0ae-b3a7cedc22c7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:42.862141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:42.862758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:42.863035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:42.863494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:42.876866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:42.878646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:42.889413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1112/2200] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:47.737873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:47.738342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:47.738457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:47.787950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] MFA Rules not processed for user `af4d2d130fb6491e95176364bcdb0833`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:47.789394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:47.901180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1089/2201] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:47.902377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:47.916340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6136-cb77-4524-a323-091711fe8eba service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:47.922866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:47.923483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:47.923768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:47.924040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:47.924700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:47.926673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:47.961629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1113/2202] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:42:47 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:42:47.962719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:47.976237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7edc8-fcd2-48ba-8a89-e22cc1d87231 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:48.043526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:48.044184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:48.044483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:48.044732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:48.045366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:48.047296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:48.073407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1090/2203] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:42:47 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:42:48.074702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:48.085281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db548e0-b8da-4fc1-9d4b-2acdfbf1a1b1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:48.089886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:48.090467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:48.090743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:48.091011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:48.091648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:48.093303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:48.104466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1114/2204] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:48.109242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:48.119590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e2b00-9cf9-4e3d-912c-b1e56afab90d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:48.124974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:48.125640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:48.125915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:48.126186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] PATH_INFO: `/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5/users/3e361e0f5e9242a6b7bdbc39929d49ef/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:48.136705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:48.144751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b390ddec8f9643b4ae3a2c5a518009e5, user_id=3e361e0f5e9242a6b7bdbc39929d49ef, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:48.148270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:48.166018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1091/2205] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:48 2022] PUT /identity/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5/users/3e361e0f5e9242a6b7bdbc39929d49ef/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:42:48.170352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:48.199830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b215d0-78d0-4c8f-bbec-ae5f567deec0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:48.278803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:48.279601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:48.280031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:48.280477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:48.281557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:48.283362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51054e16-f6d9-4849-a9a9-d974dee37ba0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:48.296092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1115/2206] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:42:48.299625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:48.311828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87a01f-9da1-4002-9954-d8d9045804dc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:48.316844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:48.317593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:48.317933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:48.318256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] PATH_INFO: `/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5/users/3e361e0f5e9242a6b7bdbc39929d49ef/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:48.320884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b390ddec8f9643b4ae3a2c5a518009e5, user_id=3e361e0f5e9242a6b7bdbc39929d49ef, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:48.324217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:48.337715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1092/2207] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:42:48 2022] PUT /identity/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5/users/3e361e0f5e9242a6b7bdbc39929d49ef/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:42:54.346355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a00-83a2-4057-bba3-97814d5a584e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:54.346933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a00-83a2-4057-bba3-97814d5a584e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:54.346933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a00-83a2-4057-bba3-97814d5a584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:54.386889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b6079a00-83a2-4057-bba3-97814d5a584e None None] MFA Rules not processed for user `3e361e0f5e9242a6b7bdbc39929d49ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:54.388575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6079a00-83a2-4057-bba3-97814d5a584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:54.507586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1116/2208] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:54.517098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:54.519602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:54.635841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adde54-3648-4644-8e8d-465ae1a055bc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:54.640868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:54.641731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:54.642328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:54.642619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:54.726137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:54.727946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:54.740678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1093/2209] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:42:54.906300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de1b-95e5-4a30-96df-c107fbde7fb3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:54.906588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de1b-95e5-4a30-96df-c107fbde7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:54.906861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157de1b-95e5-4a30-96df-c107fbde7fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:54.929881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a157de1b-95e5-4a30-96df-c107fbde7fb3 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:54.931094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a157de1b-95e5-4a30-96df-c107fbde7fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:54.951466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:42:55.025781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1117/2210] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:55.190742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:55.192195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:55.281255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bd56b-c1ea-4e22-b42f-f29a4de2fb17 service glance] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:55.286543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b151-2876-411f-806d-09647b2c49af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:55.287215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b151-2876-411f-806d-09647b2c49af service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:55.287564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b151-2876-411f-806d-09647b2c49af service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:55.288166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b151-2876-411f-806d-09647b2c49af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:55.297621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b151-2876-411f-806d-09647b2c49af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:55.299384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b151-2876-411f-806d-09647b2c49af service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:55.308977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1094/2211] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 16:42:56.367122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51563b-1bc9-404d-842d-044df09dbd43 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:56.367615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51563b-1bc9-404d-842d-044df09dbd43 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:56.367734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51563b-1bc9-404d-842d-044df09dbd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:56.395383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c51563b-1bc9-404d-842d-044df09dbd43 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:42:56.396930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c51563b-1bc9-404d-842d-044df09dbd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:42:56.412758 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1118/2212] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:42:56.424467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b151-2876-411f-806d-09647b2c49af service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:42:56.441130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b151-2876-411f-806d-09647b2c49af service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:42:56.462996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:42:56.462996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:42:56.462996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:42:56.462996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:42:56.471067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:42:56.473013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0eee9-f803-42fc-b6e8-15baf20b3ecb service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:42:56.499982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1095/2213] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:42:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:43:00.441609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72158-77e5-4b09-8fc4-5dab821cf7fc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:00.442222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72158-77e5-4b09-8fc4-5dab821cf7fc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:00.442222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a72158-77e5-4b09-8fc4-5dab821cf7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:00.564405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19a72158-77e5-4b09-8fc4-5dab821cf7fc None None] MFA Rules not processed for user `3386d02e3c3846b48074b02f4889bba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:00.569633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19a72158-77e5-4b09-8fc4-5dab821cf7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:00.756494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1119/2214] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:00.992912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b59e-6bb3-4ade-9f2a-7108b74b6a82 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:00.994548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b59e-6bb3-4ade-9f2a-7108b74b6a82 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:00.995548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b59e-6bb3-4ade-9f2a-7108b74b6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:01.015204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:01.036703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-39b8b59e-6bb3-4ade-9f2a-7108b74b6a82 None None] MFA Rules not processed for user `453b6e46935f44d09271e2720e4c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:01.037943 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-39b8b59e-6bb3-4ade-9f2a-7108b74b6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:01.191906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1096/2215] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:08.453876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af36a-a01b-47b9-96ec-d8cfa5c52eda None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:08.455442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af36a-a01b-47b9-96ec-d8cfa5c52eda None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:08.455942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2af36a-a01b-47b9-96ec-d8cfa5c52eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:08.479126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ff2af36a-a01b-47b9-96ec-d8cfa5c52eda None None] MFA Rules not processed for user `af4d2d130fb6491e95176364bcdb0833`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:08.480790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ff2af36a-a01b-47b9-96ec-d8cfa5c52eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:08.500107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1120/2216] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:11.173773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=23 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:12.830774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11460-0f89-4bf4-8c9a-d9a3273b062b None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:12.831382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11460-0f89-4bf4-8c9a-d9a3273b062b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:12.831382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11460-0f89-4bf4-8c9a-d9a3273b062b None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:12.832901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1097/2217] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:43:12.839922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d02c9-18e2-43a9-a2e1-96a3dc36281a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:12.839922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d02c9-18e2-43a9-a2e1-96a3dc36281a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:12.840589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d02c9-18e2-43a9-a2e1-96a3dc36281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:12.862145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c14d02c9-18e2-43a9-a2e1-96a3dc36281a None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:12.863459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c14d02c9-18e2-43a9-a2e1-96a3dc36281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:12.954508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1121/2218] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:12.968737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a11460-0f89-4bf4-8c9a-d9a3273b062b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:12.989517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a11460-0f89-4bf4-8c9a-d9a3273b062b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:13.006567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:13.007432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.007720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.007998 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.015601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170a494-2158-4164-af76-7a87510ba94e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.017121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170a494-2158-4164-af76-7a87510ba94e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.018219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170a494-2158-4164-af76-7a87510ba94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.030680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:13.032158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a8b9b-257f-4af8-887b-2fd80e196291 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:13.044739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4170a494-2158-4164-af76-7a87510ba94e None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:13.046058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4170a494-2158-4164-af76-7a87510ba94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:13.062922 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1122/2219] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:43:13.063560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1098/2220] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:13.076740 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170a494-2158-4164-af76-7a87510ba94e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:13.107466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170a494-2158-4164-af76-7a87510ba94e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:13.117898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:13.118841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.119298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.119746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.130252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:13.132174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d84187-0551-4ac9-aece-6b2211ae8a6d service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:13.143293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1123/2221] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:43:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:43:13.187447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623913-4f46-48df-ae27-ca6687c21152 None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.187738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623913-4f46-48df-ae27-ca6687c21152 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.188096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623913-4f46-48df-ae27-ca6687c21152 None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.189857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1099/2222] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:43:13.195354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c649a-dd60-4dbc-854a-c55ee181fdd1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.195645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c649a-dd60-4dbc-854a-c55ee181fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.195948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c649a-dd60-4dbc-854a-c55ee181fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.231946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0b8c649a-dd60-4dbc-854a-c55ee181fdd1 None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:13.236242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b8c649a-dd60-4dbc-854a-c55ee181fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:13.285250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:13.350923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1124/2223] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:13.365651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623913-4f46-48df-ae27-ca6687c21152 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:13.383696 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623913-4f46-48df-ae27-ca6687c21152 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:13.391895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:13.392671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.392958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.393238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.402085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:13.403535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab62e57-0db4-45ae-9f69-f2f7c86de8d6 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:13.414659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1100/2224] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:13.581622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf186-fb6e-4873-a2fd-4c25856584ac None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.582858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf186-fb6e-4873-a2fd-4c25856584ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.582858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf186-fb6e-4873-a2fd-4c25856584ac None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.585450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1125/2225] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:43:13.595950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63258673-07c3-4601-8b32-c9d25be6b1ea None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.597660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63258673-07c3-4601-8b32-c9d25be6b1ea None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.600648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63258673-07c3-4601-8b32-c9d25be6b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.655394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-63258673-07c3-4601-8b32-c9d25be6b1ea None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:13.660847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-63258673-07c3-4601-8b32-c9d25be6b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:13.696389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1101/2226] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:13.711117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faf186-fb6e-4873-a2fd-4c25856584ac None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:13.727328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faf186-fb6e-4873-a2fd-4c25856584ac None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:13.737379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:13.738651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:13.739221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:13.739798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:13.764987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:13.768041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:13.785242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1126/2227] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:43:23.633118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=15 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:23.779117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=18 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:25.020936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:25.021432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:25.021547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:25.040424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:25.041657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:25.048817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1102/2228] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:25.063226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:25.075340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59560-0e9e-4e51-841e-bb2cc5dbb80d service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:25.080485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:25.081090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:25.081394 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:25.082200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:25.091119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:25.092950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740f51-a87c-48ed-b640-6992e9b4254d service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:25.101581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1127/2229] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 16:43:35.035624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:35.098203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:43:40.948893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:40.951606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:41.073569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11782b0d-f4a2-47f1-b760-215b1773e3b1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:41.079530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:41.080254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:41.080535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:41.080807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:41.082634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:41.094992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:41.096794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:41.112681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1103/2230] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:43.564911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0302-4865-441d-be15-f9b4449884c7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:43.565518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0302-4865-441d-be15-f9b4449884c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:43.565518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0302-4865-441d-be15-f9b4449884c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:43.607386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-984e0302-4865-441d-be15-f9b4449884c7 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:43.608712 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-984e0302-4865-441d-be15-f9b4449884c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:43.617001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1128/2231] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:43.631535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:43.643803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b5415-02f1-4f88-b5b4-a9bae8a529e7 service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:43.649436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:43.650091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:43.650648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:43.651125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:43.661901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:43.664464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:43.676090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1104/2232] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:43:53.261625 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2127ca-2d92-4240-9bac-62f77e858394 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:53.262561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2127ca-2d92-4240-9bac-62f77e858394 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:53.263144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2127ca-2d92-4240-9bac-62f77e858394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:53.297275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c2127ca-2d92-4240-9bac-62f77e858394 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:53.298799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c2127ca-2d92-4240-9bac-62f77e858394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:53.445090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1129/2233] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:53.463289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:53.464737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:53.487130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e441dab-277a-4b0c-959a-ba9620b44f0e service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:53.511073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:53.512018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:53.512529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:53.513580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:53.524663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:53.527502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f6acf-cf45-43cc-9dc7-4b8dce815512 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:53.551693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1105/2234] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:55.807337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:55.807798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:55.808015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:55.826815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] MFA Rules not processed for user `229ab54ddaee45dabf1c38d5d049528d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:55.827983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:55.881292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1130/2235] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:43:56.527930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:56.528386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:56.528703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:56.582872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:56.589473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:56.604377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1106/2236] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:56.625322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:56.626830 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:56.647115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4effc7-311c-4648-92ab-a751f8f50525 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:56.655453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:56.656421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:56.656881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:56.657304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:56.669039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:56.670988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c1983-d389-4df5-ae8d-f1fe1a96e8c7 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:56.685587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1131/2237] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:57.836275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:57.837706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:57.849465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15a48-b4a9-483f-8e4d-9d316cd5222f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:57.853671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:57.854267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:57.854544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:57.854814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:57.863625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:57.865147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:57.875036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1107/2238] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:43:59.615918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ae86-dba4-4120-a21a-07b94dd6ea8a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:59.616554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ae86-dba4-4120-a21a-07b94dd6ea8a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:59.616904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4ae86-dba4-4120-a21a-07b94dd6ea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:59.640803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d0c4ae86-dba4-4120-a21a-07b94dd6ea8a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:43:59.642135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d0c4ae86-dba4-4120-a21a-07b94dd6ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:43:59.650646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1132/2239] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:43:59.665240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:43:59.678419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ee89-9328-428a-90bc-2bdcf6d85b08 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:43:59.684155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:43:59.684773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:43:59.685124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:43:59.685382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:43:59.694383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:43:59.695989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:43:59.706326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1108/2240] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:44:02.808568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cbde-59f0-49bd-82e5-06751c3d1a56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:02.809125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cbde-59f0-49bd-82e5-06751c3d1a56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:02.809125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cbde-59f0-49bd-82e5-06751c3d1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:02.829080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71c7cbde-59f0-49bd-82e5-06751c3d1a56 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:02.830284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71c7cbde-59f0-49bd-82e5-06751c3d1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:02.838728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1133/2241] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:02.853529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:02.865811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e02c9c-26ed-480f-8547-436598d79927 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:02.872952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:02.873555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:02.874034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:02.874150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:02.883183 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:02.891305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:02.904203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1109/2242] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:44:05.996950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:05.997455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:05.997555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:06.005517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=68 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:06.018611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:06.019806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:06.032352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1134/2243] 10.222.0.46 () {58 vars in 1016 bytes} [Thu Aug 18 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:06.054701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:06.060606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=66 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:06.066842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae9a9-03ae-4b4a-8333-f3220e4b5354 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:06.072855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:06.073439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:06.073716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:06.073988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:06.082046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:06.083621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:06.093462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1110/2244] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:44:16.013575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:16.089393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:38.192589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:38.194332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:38.209367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2324c-3192-43df-9b92-c6a3f1543b9b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:38.219028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:38.219756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:38.220213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:38.220721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] PATH_INFO: `/v3/users/3386d02e3c3846b48074b02f4889bba5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:38.222254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3386d02e3c3846b48074b02f4889bba5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:38.224776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:38.278239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3386d02e3c3846b48074b02f4889bba5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.279234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3386d02e3c3846b48074b02f4889bba5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.293850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3386d02e3c3846b48074b02f4889bba5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.294667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3386d02e3c3846b48074b02f4889bba5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.303208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e011a1c1-15d2-493b-afa2-6c90603505e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3386d02e3c3846b48074b02f4889bba5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.324565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1135/2245] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:44:38 2022] DELETE /identity/v3/users/3386d02e3c3846b48074b02f4889bba5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:44:38.601474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:38.614219 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146ff-995e-4327-9f1e-062861e65852 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:38.732618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:38.733544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:38.733982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:38.734564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] PATH_INFO: `/v3/projects/01e13f7ddaf34e50ab54627a8541abb5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:38.735931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e13f7ddaf34e50ab54627a8541abb5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:38.738846 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:38.809260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e13f7ddaf34e50ab54627a8541abb5', 'request_id': 'req-23a6b7cf-d36a-40cb-8764-b273bc4e6029'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.815147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e13f7ddaf34e50ab54627a8541abb5', 'request_id': 'req-23a6b7cf-d36a-40cb-8764-b273bc4e6029'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.824677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e13f7ddaf34e50ab54627a8541abb5', 'request_id': 'req-23a6b7cf-d36a-40cb-8764-b273bc4e6029'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.837076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] The token cache is being invalidate because project 01e13f7ddaf34e50ab54627a8541abb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:44:38.837411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.838024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-23a6b7cf-d36a-40cb-8764-b273bc4e6029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:44:38.839515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1111/2246] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:44:38 2022] DELETE /identity/v3/projects/01e13f7ddaf34e50ab54627a8541abb5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:44:38.845584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:38.845894 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:38.846177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:38.868350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:38.869605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:38.941389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1136/2247] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:38.950241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:38.950849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:38.951220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:38.972793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:38.974137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:38.982932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1112/2248] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:38.987566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:38.998880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb2a7-5b02-41a0-9fcb-9e6a19aae0fd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.003724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.004480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.005245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.005703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.006463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:44:39.006867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.008809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.023530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1137/2249] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:44:39.029273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.042376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343111-3170-454b-a1a1-51a8abd4baaf None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.050635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.050793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.051046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.051313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.052100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.053873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.084097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1113/2250] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:44:39 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:44:39.086587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.098184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e0e0c-bfbb-4991-a150-d9decbdec884 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.157586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.158199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.158479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.158752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.159382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.161352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.169291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:39.184521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1138/2251] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:44:39 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:44:39.188773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.199556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc4bea-2980-471a-ba3b-fffe3e241450 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.205380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.206598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.206945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.207296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.208016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.209716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.223760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1114/2252] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:44:39.224931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.235132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b816-3af7-497c-8a69-5db00c12df5b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.239946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.240630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.240974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.241312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.242013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.243668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa956ec-8a45-41f2-ae34-675dae10fd71 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.258065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1139/2253] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:44:39.259959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.286173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e37063-cc79-4b3b-8745-aa46a1ae3e33 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.292932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.294745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.294745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.294745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] PATH_INFO: `/v3/projects/b76b6ef465304caa91acfa19a8df12b3/users/fb24aa1a986b46a795c566bbfdcd16b5/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.311090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76b6ef465304caa91acfa19a8df12b3, user_id=fb24aa1a986b46a795c566bbfdcd16b5, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.313841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.329830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1115/2254] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:44:39 2022] PUT /identity/v3/projects/b76b6ef465304caa91acfa19a8df12b3/users/fb24aa1a986b46a795c566bbfdcd16b5/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:44:39.334684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5654f-8ecb-4f68-b3d8-c62a389c3575 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.334967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5654f-8ecb-4f68-b3d8-c62a389c3575 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.335243 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5654f-8ecb-4f68-b3d8-c62a389c3575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.357433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2cc5654f-8ecb-4f68-b3d8-c62a389c3575 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:39.358689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2cc5654f-8ecb-4f68-b3d8-c62a389c3575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:39.440038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1140/2255] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:39.447408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:39.450917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:39.493233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:39.532720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc103aa8-2d92-4166-a5dd-075300e875fa admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:39.537809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:39.538509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:39.538936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:39.539308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:39.552654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:39.554164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5958ae7-04f3-40b3-adc6-b7b0f7afe0da service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:39.577257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1116/2256] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:44:43.317142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:43.317761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:43.317761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:43.341527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] MFA Rules not processed for user `c19359f992c54313b7b1dfee4553f7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:43.342766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:43.422879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1141/2257] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:44.742158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:44.742605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:44.742850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:44.789879 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] MFA Rules not processed for user `fb24aa1a986b46a795c566bbfdcd16b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:44.797524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:44.950171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1117/2258] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:44.955181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:44.971345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a93f1-9959-4818-a8a2-0c9cf6f39335 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:44.983248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:44.984002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:44.984620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:44.984990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:44.985692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:44.987680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.032585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1142/2259] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:44:44 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:44:45.036372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:45.048962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714e52-6526-4c17-8068-cb2d3ed15d3a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:45.112628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:45.113355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:45.113698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:45.114036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:45.114733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:45.116945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.139464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1118/2260] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:44:45 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:44:45.143411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:45.154100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5f16-99b5-4765-9710-a62e7ea0eca7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:45.158751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:45.159354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:45.159633 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:45.159905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:45.160590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:45.162203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.176104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1143/2261] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:44:45.177554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:45.188381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664b246-9b57-494f-8fa9-934aeb9a2f8c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:45.193305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:45.193971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:45.194303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:45.194584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] PATH_INFO: `/v3/projects/883b009154f0469c8ff6a850d630d3d6/users/150b5f93191d45168ae07755c6ed7958/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:45.210324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883b009154f0469c8ff6a850d630d3d6, user_id=150b5f93191d45168ae07755c6ed7958, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:45.213135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.226474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1119/2262] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:44:45 2022] PUT /identity/v3/projects/883b009154f0469c8ff6a850d630d3d6/users/150b5f93191d45168ae07755c6ed7958/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:44:45.230380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:45.241104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c08d-1107-4d34-a69f-e62271808506 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:45.293656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:45.308930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:45.310146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:45.310435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:45.310709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:45.311389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:45.321364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52f72-cd28-4e0d-82a7-8461d97a2468 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.343702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1144/2263] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:44:45.347888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:45.360588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad53fb7-70dd-4496-a7b8-d7f46100b770 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:45.365375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:45.366033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:45.366412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:45.366692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] PATH_INFO: `/v3/projects/883b009154f0469c8ff6a850d630d3d6/users/150b5f93191d45168ae07755c6ed7958/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:45.372937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=883b009154f0469c8ff6a850d630d3d6, user_id=150b5f93191d45168ae07755c6ed7958, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:45.375596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:45.387800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1120/2264] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:44:45 2022] PUT /identity/v3/projects/883b009154f0469c8ff6a850d630d3d6/users/150b5f93191d45168ae07755c6ed7958/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:44:51.616518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577a429-1ee9-4fca-b196-c922afa5cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:51.617662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577a429-1ee9-4fca-b196-c922afa5cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:51.617923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577a429-1ee9-4fca-b196-c922afa5cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:51.649026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0577a429-1ee9-4fca-b196-c922afa5cdb5 None None] MFA Rules not processed for user `150b5f93191d45168ae07755c6ed7958`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:51.650222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0577a429-1ee9-4fca-b196-c922afa5cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:51.718887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1145/2265] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:51.732544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:44:51.734539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:51.756734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:44:51.831399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2748b-9853-4419-813b-b754f69639aa admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:44:51.837237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:44:51.837852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:51.838128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:51.838738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:51.910427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:44:51.912118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8e6ba-caca-4399-85a3-341db355e967 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:44:51.924724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1121/2266] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:44:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:44:53.324487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd142-8bb1-4b7b-abe2-4f42aec57fff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:53.325071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd142-8bb1-4b7b-abe2-4f42aec57fff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:53.325071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fd142-8bb1-4b7b-abe2-4f42aec57fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:53.344747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0e6fd142-8bb1-4b7b-abe2-4f42aec57fff None None] MFA Rules not processed for user `fb24aa1a986b46a795c566bbfdcd16b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:53.345984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e6fd142-8bb1-4b7b-abe2-4f42aec57fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:53.352999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1146/2267] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:44:59.917964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375913f8-d128-4e30-82b3-c3c5fbb73918 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:44:59.918504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375913f8-d128-4e30-82b3-c3c5fbb73918 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:44:59.918504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375913f8-d128-4e30-82b3-c3c5fbb73918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:44:59.937811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-375913f8-d128-4e30-82b3-c3c5fbb73918 None None] MFA Rules not processed for user `d5cca2e6407147fd99a92e8f0132d08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:44:59.938940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-375913f8-d128-4e30-82b3-c3c5fbb73918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:44:59.993640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1122/2268] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:45:03.338548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=43 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:07.640408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:07.641020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:07.641020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:07.659319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] MFA Rules not processed for user `453b6e46935f44d09271e2720e4c70b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:45:07.660532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:07.728214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1147/2269] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:45:09.986817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=76 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:16.767756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:16.768537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:16.768537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:16.788157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] MFA Rules not processed for user `229ab54ddaee45dabf1c38d5d049528d`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:45:16.789369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:16.846628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1123/2270] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:45:17.720596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=25 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:23.213208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:45:23.268041 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63897f-9384-43b8-81d6-4a43fc7a97c6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:45:23.272888 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:45:23.273485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:23.273761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:23.274026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:23.282742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:45:23.284175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:45:23.293536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1148/2271] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:45:26.840584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=25 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:33.289230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=26 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:47.837851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:45:47.851110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5435e-cb96-4fe2-830b-a4a7049b7226 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:45:47.856530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:45:47.857118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:47.857398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:47.857672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:47.860035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:47.916003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:45:47.917602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:45:47.927056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1124/2272] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:45:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:45:48.042026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:45:48.043413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:48.099775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3c65-75dd-4486-a7be-11633d94a293 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:45:48.103312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:45:48.103904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:48.104229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:48.104486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:48.106176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:48.119029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:45:48.120483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:45:48.131358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1149/2273] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:45:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:45:48.285985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:45:48.287311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:48.298790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402648a-49db-463c-954b-eb7b6a5149c5 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:45:48.302868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:45:48.303827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:45:48.304334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:45:48.304590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:45:48.306255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:45:48.321447 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:45:48.322885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:45:48.334960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1125/2274] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:45:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:45:58.126321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=26 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:45:58.330061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=34 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:00.744873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:00.756798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f802fb1-a97e-4981-95dc-494ba4e14658 service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:00.760576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:00.761286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:00.761631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:00.761993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:00.763874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:00.774976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:00.776639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:00.785546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1150/2275] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:02.724863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:02.736631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c2248-06e4-4043-9f33-cd4d2907ad55 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:02.742192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:02.742825 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:02.743104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:02.743557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:02.745330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:02.758736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:02.760364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:02.771347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1126/2276] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:03.307502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:03.309526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:03.374792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d809-3631-41c7-baee-6df0236a0fbc service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:03.378883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:03.379486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:03.379770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:03.380050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:03.382014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:03.392643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:03.394629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1838a-72d4-466f-b97e-9480eb2c96b8 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:03.405164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1151/2277] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:05.266894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:05.278905 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca555f-b7e4-4eef-8fce-2ea044fea229 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:05.284440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:05.285030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:05.285309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:05.285579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:05.287266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:05.297197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:05.299258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:05.307980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1127/2278] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:11.358183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ebd9-c237-45ad-8b34-8099180de7a7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:11.358719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:11.359081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ebd9-c237-45ad-8b34-8099180de7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:11.359081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ebd9-c237-45ad-8b34-8099180de7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:11.371693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f54cb-70bc-4d5b-8b0e-faa042af2418 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:11.378962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:11.379522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3371ebd9-c237-45ad-8b34-8099180de7a7 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:11.379868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:11.380260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:11.380609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:11.381031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3371ebd9-c237-45ad-8b34-8099180de7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:11.382741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:11.395669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:11.397408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:11.409174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1128/2279] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:11.455357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1152/2280] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:11.508650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:11.510071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:11.586180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf525-9350-4515-8950-2f6e2eb98e2b service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:11.591522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:11.592171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:11.592445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:11.592721 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:11.601801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:11.603798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:11.627904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1129/2281] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:46:13.933588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fd2-f226-4203-a74d-950276917365 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:13.934550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fd2-f226-4203-a74d-950276917365 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:13.935899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a96fd2-f226-4203-a74d-950276917365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:13.958282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-75a96fd2-f226-4203-a74d-950276917365 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:13.960037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-75a96fd2-f226-4203-a74d-950276917365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:13.975033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1153/2282] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:13.983859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:13.996105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203e40-96cd-4c4f-b964-c3fbb4aa7e4d service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:14.002184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:14.002991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:14.003349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:14.003714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:14.014671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:14.017643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:14.030081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1130/2283] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 16:46:17.969655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a96fd2-f226-4203-a74d-950276917365 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:17.998978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a96fd2-f226-4203-a74d-950276917365 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:18.006912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:18.007796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:18.008364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:18.008881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:18.011663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:18.040354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:18.043136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:18.056071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1154/2284] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:20.059921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:20.061434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:20.391793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c7a5-fbca-40e0-bd49-23d9a79ab385 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:20.397683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:20.398521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:20.412369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:20.412968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:20.421224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:20.455786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:20.459322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:20.486021 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1131/2285] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:25.600343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:25.601884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:25.617764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19548-f95c-4782-850e-d41548622be2 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:25.622802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:25.623398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:25.623675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:25.623945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:25.625668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:25.637751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:25.639330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:25.651916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1155/2286] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:25.746048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:25.747535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:25.798341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:25.834176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170981b-0ee1-46c3-b186-3cb6b9413621 service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:25.838864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:25.839485 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:25.839763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:25.840089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] PATH_INFO: `/v3/users/af4d2d130fb6491e95176364bcdb0833` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:25.841270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4d2d130fb6491e95176364bcdb0833)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:25.843181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:25.890066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4d2d130fb6491e95176364bcdb0833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:25.890765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4d2d130fb6491e95176364bcdb0833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:25.898669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4d2d130fb6491e95176364bcdb0833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:25.906062 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4d2d130fb6491e95176364bcdb0833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:25.906713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4d2d130fb6491e95176364bcdb0833'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:25.923525 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1132/2287] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:25 2022] DELETE /identity/v3/users/af4d2d130fb6491e95176364bcdb0833 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:26.098276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:26.110890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516a2a-2535-40b3-ace1-0bc92458a00d service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:26.174104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:26.174678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:26.174957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:26.175226 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] PATH_INFO: `/v3/projects/ff8b3642f5c847a6955f698566d3ad05` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:26.176367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8b3642f5c847a6955f698566d3ad05)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:26.178852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:26.181056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:26.224361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8b3642f5c847a6955f698566d3ad05', 'request_id': 'req-e4e0cde1-d554-4c33-83e1-41d2637b30a1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.229942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8b3642f5c847a6955f698566d3ad05', 'request_id': 'req-e4e0cde1-d554-4c33-83e1-41d2637b30a1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.236719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8b3642f5c847a6955f698566d3ad05', 'request_id': 'req-e4e0cde1-d554-4c33-83e1-41d2637b30a1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.248623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] The token cache is being invalidate because project ff8b3642f5c847a6955f698566d3ad05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:26.248914 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.249616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.252751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1156/2288] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:26 2022] DELETE /identity/v3/projects/ff8b3642f5c847a6955f698566d3ad05 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:26.256983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:26.258693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:26.272920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8a30-dc19-409f-b6c8-45873d518900 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:26.328715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:26.329351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:26.329629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:26.329901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] PATH_INFO: `/v3/users/3e361e0f5e9242a6b7bdbc39929d49ef` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:26.331022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e361e0f5e9242a6b7bdbc39929d49ef)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:26.332980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:26.378920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e361e0f5e9242a6b7bdbc39929d49ef'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.379580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e361e0f5e9242a6b7bdbc39929d49ef'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.381286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:26.388009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e361e0f5e9242a6b7bdbc39929d49ef'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.396216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e361e0f5e9242a6b7bdbc39929d49ef'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.396875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e361e0f5e9242a6b7bdbc39929d49ef'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.413590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1133/2289] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:26 2022] DELETE /identity/v3/users/3e361e0f5e9242a6b7bdbc39929d49ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:26.583120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:26.584591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:26.599038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0cde1-d554-4c33-83e1-41d2637b30a1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:26.657942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:26.658591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:26.658874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:26.659148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] PATH_INFO: `/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:26.660778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b390ddec8f9643b4ae3a2c5a518009e5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:26.663246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:26.727310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b390ddec8f9643b4ae3a2c5a518009e5', 'request_id': 'req-03905c14-28d0-4117-83cc-70f62791adcb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.735229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b390ddec8f9643b4ae3a2c5a518009e5', 'request_id': 'req-03905c14-28d0-4117-83cc-70f62791adcb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.742768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b390ddec8f9643b4ae3a2c5a518009e5', 'request_id': 'req-03905c14-28d0-4117-83cc-70f62791adcb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.759377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] The token cache is being invalidate because project b390ddec8f9643b4ae3a2c5a518009e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:26.759741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.761016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:26.778106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1157/2290] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:26 2022] DELETE /identity/v3/projects/b390ddec8f9643b4ae3a2c5a518009e5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:28.519991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:28.521545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:28.579220 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63e58-f356-4bb1-bb27-c0f11b02780d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:28.641505 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:28.642995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:28.642995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:28.642995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:28.644602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:28.728157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:28.730791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:28.747568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1134/2291] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:30.249372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:30.250875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:30.304987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:30.378858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03905c14-28d0-4117-83cc-70f62791adcb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:30.384839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:30.385470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:30.385747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:30.386017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:30.387860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:30.400655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:30.402583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:30.420137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1158/2292] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:46:33.756732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:33.759031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:33.807768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:33.865648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64291837-167e-4ba3-96cf-ed37e3dec20c service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:33.872813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:33.873763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:33.874288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:33.874786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:33.877873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:33.901605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:33.903382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:33.918099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1135/2293] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:34.095128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:34.097198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:34.123534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d918012-bcda-477e-bd16-d2876fac09f4 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:34.133421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:34.135291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.135706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.136099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] PATH_INFO: `/v3/users/453b6e46935f44d09271e2720e4c70b4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.137528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453b6e46935f44d09271e2720e4c70b4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:34.139965 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:34.223546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453b6e46935f44d09271e2720e4c70b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.224372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453b6e46935f44d09271e2720e4c70b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.241802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453b6e46935f44d09271e2720e4c70b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.242647 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453b6e46935f44d09271e2720e4c70b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.251699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5e56533c-2278-48ba-94a8-6f7e930dd9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453b6e46935f44d09271e2720e4c70b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.268043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1159/2294] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:34 2022] DELETE /identity/v3/users/453b6e46935f44d09271e2720e4c70b4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:34.495515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:34.515081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3682a-bf1f-45a3-a35f-86f7fa8ead6c service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:34.598112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:34.598834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.599527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.599527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] PATH_INFO: `/v3/projects/043b300990b94547a44cca41f376a62f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.600993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043b300990b94547a44cca41f376a62f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:34.603169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:34.653348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043b300990b94547a44cca41f376a62f', 'request_id': 'req-e5b30632-9295-4136-b2da-13fc3a88c499'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.661929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043b300990b94547a44cca41f376a62f', 'request_id': 'req-e5b30632-9295-4136-b2da-13fc3a88c499'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.670623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043b300990b94547a44cca41f376a62f', 'request_id': 'req-e5b30632-9295-4136-b2da-13fc3a88c499'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.682993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] The token cache is being invalidate because project 043b300990b94547a44cca41f376a62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:34.683275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.683903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e5b30632-9295-4136-b2da-13fc3a88c499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:34.685427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1136/2295] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:34 2022] DELETE /identity/v3/projects/043b300990b94547a44cca41f376a62f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:34.690614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.690907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.691193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.711418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:34.713270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:34.795839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1160/2296] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:34.807492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.808425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.808425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.838595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:34.840104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:34.849781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1137/2297] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:34.854072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:34.865776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322e7a0-6f47-4485-a51a-a1cd1ae9097f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:34.870543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:34.871152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.871428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.871694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.872385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:34.872682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:34.874277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:34.890657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1161/2298] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:34.896327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:34.907364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c8cf-0786-456d-a622-9dbd34ca6f88 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:34.914092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:34.914703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:34.915244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:34.915523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:34.916178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:34.919409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:34.965071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1138/2299] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:34 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:34.966542 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:34.976759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba64f8-c164-47c8-8939-534b5c675561 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:34.980399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:35.038256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:35.039694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.040026 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.040442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.041233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:35.043221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:35.070327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1162/2300] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:34 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:35.071492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:35.083478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cc092-322b-44c1-924b-31472a915e57 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:35.088489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:35.089248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.089755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.090030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.090671 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:35.093412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:35.106297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1139/2301] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:35.109989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:35.120721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813be277-aa1f-456d-ac0c-79a8b8ef5480 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:35.131397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:35.132290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.132586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.132855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.133501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:35.135348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66436e-e0ea-40f7-b890-1184490c8e0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:35.154146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1163/2302] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:35.155633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:35.184195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cc0dc-86dd-4858-99d8-128fa847cdce admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:35.198982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:35.201030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.201384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.201913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] PATH_INFO: `/v3/projects/7f083fd2cafa47dd842b818648055274/users/3a00129a388c47df8980f603ffd15fb2/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.220332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:35.235082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f083fd2cafa47dd842b818648055274, user_id=3a00129a388c47df8980f603ffd15fb2, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:35.238866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:35.260639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1140/2303] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:35 2022] PUT /identity/v3/projects/7f083fd2cafa47dd842b818648055274/users/3a00129a388c47df8980f603ffd15fb2/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:35.269322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856391f-27b1-4efe-9cad-ff15b9d6c126 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.269694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856391f-27b1-4efe-9cad-ff15b9d6c126 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.270006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856391f-27b1-4efe-9cad-ff15b9d6c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.302015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6856391f-27b1-4efe-9cad-ff15b9d6c126 None None] MFA Rules not processed for user `3a00129a388c47df8980f603ffd15fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:35.303356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6856391f-27b1-4efe-9cad-ff15b9d6c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:35.373188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1164/2304] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:35.384732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:35.386453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:35.464914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2ba09-1414-4b96-b93f-244c12387c95 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:35.469424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:35.470442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:35.470886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:35.476486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:35.488029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:35.489861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:35.502332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1141/2305] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:36.530584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:36.531063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:36.531181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:36.551365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:36.552602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:36.609077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1165/2306] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:46:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:36.622336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:36.623786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:36.696435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eab7-5f3b-4ecd-93c8-8a05240f4609 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:36.701557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:36.702160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:36.702438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:36.702709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:36.712008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:36.713848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:36.722761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1142/2307] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:46:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:46:37.629805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:37.631385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:37.692084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:37.753977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac774-bb18-4b1c-977b-6950b1d200e5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:37.758377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:37.759017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:37.759295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:37.759737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:37.769486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:37.929047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:37.931138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:37.944953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1166/2308] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:40.670639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:40.672715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:40.700301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c1451-fe47-4e53-8e8c-91327041143c service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:40.716098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:40.716977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:40.719882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:40.722586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:40.724916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:40.767668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:40.769416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:40.793569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1143/2309] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:42.927764 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:42.931815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:42.954769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaafb1-87e6-4e35-bba7-9f72b18174b8 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:42.960133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:42.961551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:42.962169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:42.962634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] PATH_INFO: `/v3/users/d5cca2e6407147fd99a92e8f0132d08c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:42.964509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cca2e6407147fd99a92e8f0132d08c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:42.973112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:43.114222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cca2e6407147fd99a92e8f0132d08c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.114943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cca2e6407147fd99a92e8f0132d08c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.160175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cca2e6407147fd99a92e8f0132d08c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.161005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cca2e6407147fd99a92e8f0132d08c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.182899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c58212c-4b3a-4d26-88ec-77efc8fa1f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cca2e6407147fd99a92e8f0132d08c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.204885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1167/2310] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:42 2022] DELETE /identity/v3/users/d5cca2e6407147fd99a92e8f0132d08c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:43.628218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:43.650629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858355ac-0369-4577-94e2-06a6909701d5 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:43.752298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:43.752944 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:43.753212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:43.753652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] PATH_INFO: `/v3/projects/326a79e2aacf42d4bc799069b1b981c1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:43.754948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=326a79e2aacf42d4bc799069b1b981c1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:43.757371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:43.766248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:43.852872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326a79e2aacf42d4bc799069b1b981c1', 'request_id': 'req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.872236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326a79e2aacf42d4bc799069b1b981c1', 'request_id': 'req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.910724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326a79e2aacf42d4bc799069b1b981c1', 'request_id': 'req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.946550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] The token cache is being invalidate because project 326a79e2aacf42d4bc799069b1b981c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:43.948597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.950667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-eb5aadaf-1ea6-43f5-8bbe-c983062ef36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:43.955738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1144/2311] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:43 2022] DELETE /identity/v3/projects/326a79e2aacf42d4bc799069b1b981c1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:43.960789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:43.961318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:43.961558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.000720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:44.003007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:44.080811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:44.141367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1168/2312] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:44.150011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.150667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.151260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.203128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:44.206716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:44.248684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1145/2313] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:44.254159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:44.283472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a46e70-b310-450a-9ea3-3fc1e1c0709b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:44.297319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:44.300128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.302396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.303130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.305891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:44.307133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:44.311813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:44.348522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1169/2314] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:46:44.352182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:44.371330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960114f-5962-4f63-8815-1dcd758dfd62 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:44.395363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:44.397706 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.398015 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.398342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.398842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:44.400774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:44.471778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1146/2315] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:44 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:44.474032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:44.487151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4735f-ccd8-4a1c-a821-009973304eaf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:44.694492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:44.696754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.697129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.697790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.700103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:44.709731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:44.828165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1170/2316] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:44 2022] POST /identity/v3/users => generated 287 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:44.834560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:44.874648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e830-dd44-4144-9896-6491578c47b3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:44.893107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:44.893742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.894019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.894286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.895265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:44.898040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:44.932142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1147/2317] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:44.937427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:44.971207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8456b-f803-4263-a291-dae2c56f546f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:44.983957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:44.986060 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:44.986599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:44.987045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:44.988582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:44.991655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e0b57-dd4e-4081-bf8d-251cbb13e00c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:45.020141 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1171/2318] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:45.021540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:45.036027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99e2d0-ca8d-4726-a1a3-ca73b2b99352 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:45.042010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:45.043654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.044224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.044795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] PATH_INFO: `/v3/projects/722cf7e372a34a969a756c66509ce0c4/users/59e2b197b2d04d9084cd8c59504fae17/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.070431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722cf7e372a34a969a756c66509ce0c4, user_id=59e2b197b2d04d9084cd8c59504fae17, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:45.073680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:45.106916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1148/2319] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:45 2022] PUT /identity/v3/projects/722cf7e372a34a969a756c66509ce0c4/users/59e2b197b2d04d9084cd8c59504fae17/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:45.120804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.121153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.121455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.194227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] MFA Rules not processed for user `59e2b197b2d04d9084cd8c59504fae17`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:45.195597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:45.306416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1172/2320] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:45.318387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:45.320124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:45.400449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc640c-9e94-4396-a4b4-8ce57d2a5ae7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:45.406031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:45.406655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.406934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.407203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.416572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:45.418293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:45.429025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1149/2321] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:45.643483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:45.644996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:45.669791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:45.696286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:45.697799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:45.736319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab835-2140-4263-9a64-5e1cf1cc1b93 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:45.741140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:45.741793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.742091 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.742348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] PATH_INFO: `/v3/users/3a00129a388c47df8980f603ffd15fb2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.743507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a00129a388c47df8980f603ffd15fb2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:45.745483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:45.777501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eea440-27b5-4ef9-b754-bf7ad249bc56 service nova] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:45.787936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:45.788464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.788572 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.788869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] PATH_INFO: `/v3/users/59e2b197b2d04d9084cd8c59504fae17` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.790250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e2b197b2d04d9084cd8c59504fae17)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:45.794418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:45.818785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a00129a388c47df8980f603ffd15fb2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.820212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a00129a388c47df8980f603ffd15fb2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.836309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a00129a388c47df8980f603ffd15fb2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.837201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a00129a388c47df8980f603ffd15fb2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.846932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4ec0469f-dcdd-4d99-9af8-a6d9af1566eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a00129a388c47df8980f603ffd15fb2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.849850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e2b197b2d04d9084cd8c59504fae17'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.850547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e2b197b2d04d9084cd8c59504fae17'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.864619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e2b197b2d04d9084cd8c59504fae17'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.866770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1173/2322] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:45 2022] DELETE /identity/v3/users/3a00129a388c47df8980f603ffd15fb2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:45.868611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.868611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.868843 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.876963 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e2b197b2d04d9084cd8c59504fae17'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.878592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9bebe60b-559b-4fd4-9932-0148262fd73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e2b197b2d04d9084cd8c59504fae17'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:45.889490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:45.890703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:45.901325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1150/2323] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:45 2022] DELETE /identity/v3/users/59e2b197b2d04d9084cd8c59504fae17 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:45.905649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:45.906004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:45.906348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:45.927110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:45.928422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:45.979970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1174/2324] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:45.996039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:46.001902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:46.010809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1151/2325] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:46.025753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:46.027079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:46.074067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464e55c-85b5-4f79-b160-d9a0b61ad6c8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:46.085310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:46.087086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:46.116196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702d658-eb8c-451e-97b1-838fb0bb565d None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:46.122533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:46.123685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.124351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.125516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.140835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:46.145718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:46.150362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:46.151380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.152834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.153292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.165250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1152/2326] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:46.166587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:46.168078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:46.188127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1175/2327] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:46.723939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:46.724978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:46.726487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:46.731849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:46.753955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f45ed-814c-4354-aa58-9fc8e1db1838 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:46.756789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff260-3d2f-4641-84a3-a18a7213e163 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:46.764305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:46.764962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.765251 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.765531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] PATH_INFO: `/v3/projects/7f083fd2cafa47dd842b818648055274` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.767005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f083fd2cafa47dd842b818648055274)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:46.768995 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:46.771933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:46.772826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.773106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.773379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] PATH_INFO: `/v3/projects/722cf7e372a34a969a756c66509ce0c4` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.774539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] RBAC: Authorizing `identity:delete_project(project_id=722cf7e372a34a969a756c66509ce0c4)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:46.776472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:46.873096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f083fd2cafa47dd842b818648055274', 'request_id': 'req-1610ba18-912d-43fe-a415-2937cd965251'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.877374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722cf7e372a34a969a756c66509ce0c4', 'request_id': 'req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.881398 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f083fd2cafa47dd842b818648055274', 'request_id': 'req-1610ba18-912d-43fe-a415-2937cd965251'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.890050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722cf7e372a34a969a756c66509ce0c4', 'request_id': 'req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.892248 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f083fd2cafa47dd842b818648055274', 'request_id': 'req-1610ba18-912d-43fe-a415-2937cd965251'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.913937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722cf7e372a34a969a756c66509ce0c4', 'request_id': 'req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.926520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] The token cache is being invalidate because project 7f083fd2cafa47dd842b818648055274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:46.926815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.928397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1610ba18-912d-43fe-a415-2937cd965251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.935056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1176/2328] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:46 2022] DELETE /identity/v3/projects/7f083fd2cafa47dd842b818648055274 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:46.936340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.936626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.936897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.938292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] The token cache is being invalidate because project 722cf7e372a34a969a756c66509ce0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:46.938938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.939993 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ed7cd3f3-359d-4849-aea0-4fd28cfa339a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:46.941890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1153/2329] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:46 2022] DELETE /identity/v3/projects/722cf7e372a34a969a756c66509ce0c4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:46.949664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dc85-29f6-490d-bea5-14f14ccb490c None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:46.949844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dc85-29f6-490d-bea5-14f14ccb490c None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:46.950202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6dc85-29f6-490d-bea5-14f14ccb490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:46.976521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:46.976521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:46.983849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8ee6dc85-29f6-490d-bea5-14f14ccb490c None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:46.985392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8ee6dc85-29f6-490d-bea5-14f14ccb490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.033852 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1177/2330] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.035301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.036599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.048699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa27cb3-952b-4a19-b99a-3bd10abe245b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.053219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.053813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.054094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.054366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] PATH_INFO: `/v3/users/229ab54ddaee45dabf1c38d5d049528d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.061384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1154/2331] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.061544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229ab54ddaee45dabf1c38d5d049528d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.061651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b99d5-38a0-4833-bdf4-5d94b80a8595 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.061651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b99d5-38a0-4833-bdf4-5d94b80a8595 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.061651 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b99d5-38a0-4833-bdf4-5d94b80a8595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.061932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.075830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-906b99d5-38a0-4833-bdf4-5d94b80a8595 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.077187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-906b99d5-38a0-4833-bdf4-5d94b80a8595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.085574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1155/2332] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.089170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.089170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.089170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.097956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.107653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.108916 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.109759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229ab54ddaee45dabf1c38d5d049528d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.110417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229ab54ddaee45dabf1c38d5d049528d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.117765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1156/2333] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.118716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.123522 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229ab54ddaee45dabf1c38d5d049528d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.124269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229ab54ddaee45dabf1c38d5d049528d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.128491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f8ba-e87d-4707-8010-563aa66705d8 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.132736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229ab54ddaee45dabf1c38d5d049528d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.134271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.134978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.135259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.135521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.136189 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:47.136488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.138059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.145779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1178/2334] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:47 2022] DELETE /identity/v3/users/229ab54ddaee45dabf1c38d5d049528d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:47.146673 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.147971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.155179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1157/2335] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:47.159396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.161287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.174645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0570ef-1d5f-4c17-888e-cda30d2044f7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.213930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.226971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538764d-af2a-40cd-88e4-ec1889c10fa2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.232944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.233559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.234401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.234623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.235221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:47.236352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.237812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.242848 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.243529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.243877 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.244305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.244994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.247627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.251807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1179/2336] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:47.256262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.268207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ba148-964d-4832-8f69-c3ab8510dea1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.274503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.275383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.275713 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.276042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.276733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.278632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.282237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1158/2337] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:47.286157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.308467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1180/2338] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:47.312456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.359854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073d2d-6b33-4725-876a-5f4a662161e0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.383367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c852851-6c03-4132-a235-a00b709ec06f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.388879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.389493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.389770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.390039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.390655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.392702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.414289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1181/2339] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:47.418282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.418797 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.419401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.419676 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.419947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.420304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.420587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.422559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.433019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94e952-eb4a-4eac-88aa-17eb78032bd9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.437916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.438537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.439386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.439670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] PATH_INFO: `/v3/projects/3d74b7f20bf448f88cacfe8cfb00d7c4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.440822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d74b7f20bf448f88cacfe8cfb00d7c4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.442730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.447997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1159/2340] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:47.447997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.451623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.455827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678e6ea-d766-4cb0-b40e-d39835e4bb00 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.461727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.462382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.462683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.463012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.463647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.465284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.476297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1160/2341] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:47.477177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.487302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3bc70-4091-436c-8e3f-0298a6b8fcf1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.496241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d74b7f20bf448f88cacfe8cfb00d7c4', 'request_id': 'req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.502381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d74b7f20bf448f88cacfe8cfb00d7c4', 'request_id': 'req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.509179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d74b7f20bf448f88cacfe8cfb00d7c4', 'request_id': 'req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.522262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] The token cache is being invalidate because project 3d74b7f20bf448f88cacfe8cfb00d7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:47.522568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.523190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:47.524739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1182/2342] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:47 2022] DELETE /identity/v3/projects/3d74b7f20bf448f88cacfe8cfb00d7c4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:47.525628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.527001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.535663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.550450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.551061 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.551342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.551616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.552282 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.553886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e87ac-8bf6-4884-b614-50925f449e9f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.563549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1161/2343] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:47.565259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.565544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.565819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.584263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.585458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.592051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b16514-e9f9-4c8d-bd66-6c206cbd3c77 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.593521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1162/2344] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.594285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.596042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.604771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.605379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.605682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.605948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.606578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.607358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02053-3d5c-47ea-9f8c-3097d0ea4d44 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.608238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccd7a8-3bb0-4efa-9461-bfaafdea1bc0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.612710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.613424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.613704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.613970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.615095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.616902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.622256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1183/2345] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:47.622256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.622256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.622256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.627986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1163/2346] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:47.628775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.640592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c05c4b-d8e2-4168-9095-843bc44b8af8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.643455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.644698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.646086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.646763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.646992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.647310 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] PATH_INFO: `/v3/projects/a6c583b60a07481b968554197dfd7a6f/users/929d7e0142864e97a9337a9fdf5cf784/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.652621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1184/2347] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.653365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.662402 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c583b60a07481b968554197dfd7a6f, user_id=929d7e0142864e97a9337a9fdf5cf784, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.662546 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4558e-e305-452d-befb-fdcba127aee7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.665163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.667064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.667707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.667977 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.668286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] PATH_INFO: `/v3/projects/d80046d265a04224b3e0e3ee7e875400/users/73ff3ab22a6d4f4092a1870aee313320/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.678203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1164/2348] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:47 2022] PUT /identity/v3/projects/a6c583b60a07481b968554197dfd7a6f/users/929d7e0142864e97a9337a9fdf5cf784/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:47.679011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.684321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80046d265a04224b3e0e3ee7e875400, user_id=73ff3ab22a6d4f4092a1870aee313320, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.687801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cb4-d7b5-4ce9-97a2-ff010bd65183 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.701737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1185/2349] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:47 2022] PUT /identity/v3/projects/d80046d265a04224b3e0e3ee7e875400/users/73ff3ab22a6d4f4092a1870aee313320/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:47.703270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2bcf-b357-4e8b-857a-cea66557a05c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.703551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2bcf-b357-4e8b-857a-cea66557a05c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.703825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2bcf-b357-4e8b-857a-cea66557a05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.739455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71ab2bcf-b357-4e8b-857a-cea66557a05c None None] MFA Rules not processed for user `929d7e0142864e97a9337a9fdf5cf784`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.740707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71ab2bcf-b357-4e8b-857a-cea66557a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.749548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2818b9e-8891-4583-abb5-19f22939bdba admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.787859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.807343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1186/2350] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.810918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.810918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.810918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.811341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.811445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.811537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.811537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.811725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:47.811725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.811725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.827978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1165/2351] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:47.827978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.834742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca0840-c991-4ac7-bbb2-9fddd203fda9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.837805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] MFA Rules not processed for user `73ff3ab22a6d4f4092a1870aee313320`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:47.838981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:47.839293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.839870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.840181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.840455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.841060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.842941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.873950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1166/2352] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:47.873950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.899171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:47.905892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1187/2353] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:47.906732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.917502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811baef-7d6e-4281-9297-a63b83bf03c4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.937951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2094d-d7ef-4585-8d73-4b65ca045b87 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:47.942691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.943295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.943576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.943849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.944507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.946409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:47.973757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1167/2354] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:47.974489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:47.974623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:47.975114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:47.975491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:47.975772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:47.976419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:47.978327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.002409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1188/2355] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:48.003221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.013211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65189d-76fb-4087-9778-79e5fed34fa3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.045607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ac43-1f53-42d4-9396-07ad471a5473 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.049745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.050348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.050627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.050893 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.051507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.053427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.073403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.074030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.074313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.074592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.075217 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.077187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.087983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1168/2356] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:47 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:48.088789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.094855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:48.103599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1189/2357] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:48 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:48.104741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.116279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda708f-3e3b-40f8-ab41-b43dc6f7c05f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.171369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33379-5778-4efd-b14b-83c02d821ca5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.177471 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.178089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.178371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.178872 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.179449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.181085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.194270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1169/2358] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.194270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.197525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.198143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.198421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.198690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.199632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.202253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.203959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de0fa2-92b1-48b9-825a-ef5bb8622b10 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.209838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.210432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.210835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.211120 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.211759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.213390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.229498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1170/2359] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.229498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.229775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1190/2360] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:48 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:48.230565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.241455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9533ec3-3c30-4231-b968-1164f3085f71 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.241823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba6fd1-ff98-4a23-8c15-bbc758a31ce7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.246353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.246958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.247212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.247456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.247573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.247745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] PATH_INFO: `/v3/projects/75737c953a084942b88232832039c6ff/users/702b4d2486164e53aba011979543e768/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.247867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.248151 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.248789 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.250367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.264099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1191/2361] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.264099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.264381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75737c953a084942b88232832039c6ff, user_id=702b4d2486164e53aba011979543e768, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.267679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.270341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:48.278821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831fec2-5669-4631-9945-5b793143cc0b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.285212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1171/2362] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:48 2022] PUT /identity/v3/projects/75737c953a084942b88232832039c6ff/users/702b4d2486164e53aba011979543e768/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:48.288989 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.343916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.344572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.345061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.345340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.346015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.347610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.357882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1192/2363] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.358705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.363741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416162-fc50-49b4-bce3-18d3df4761b5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.369184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.369847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.370127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.370403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] PATH_INFO: `/v3/projects/53a80129987745a391bf8a0b2e77b22a/users/9a64aa8923254d36b4421f4583209172/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.372212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb388e-3a55-4c33-bff5-d0a4f055c75c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.378002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.378610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.378911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.379447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.379921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.382458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.394662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a80129987745a391bf8a0b2e77b22a, user_id=9a64aa8923254d36b4421f4583209172, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.398782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.402505 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1193/2364] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.402905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.413145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c764-9de0-4177-b725-578d273eb560 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.415646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1172/2365] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:48 2022] PUT /identity/v3/projects/53a80129987745a391bf8a0b2e77b22a/users/9a64aa8923254d36b4421f4583209172/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:48.416980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.472487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.473283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.473441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.473716 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] PATH_INFO: `/v3/projects/1e18c39d593744579348bc69b546b133/users/b895e01d4f1c415bb71b4e4798eed8cf/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.478046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bac4f6-4eac-424c-9872-9be7cd493b66 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.482725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.483377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.483655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.483925 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] PATH_INFO: `/v3/projects/75737c953a084942b88232832039c6ff/users/702b4d2486164e53aba011979543e768/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.485088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:48.486056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75737c953a084942b88232832039c6ff, user_id=702b4d2486164e53aba011979543e768, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.488741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b43ed0-9045-43f5-86a3-8b928ab16e8e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.494477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e18c39d593744579348bc69b546b133, user_id=b895e01d4f1c415bb71b4e4798eed8cf, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.497582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a0de7-fc3d-496e-bdfd-4f7272617fe1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.499973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1173/2366] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:48 2022] PUT /identity/v3/projects/75737c953a084942b88232832039c6ff/users/702b4d2486164e53aba011979543e768/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:48.501834 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.502149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.502394 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.512793 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1194/2367] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:48 2022] PUT /identity/v3/projects/1e18c39d593744579348bc69b546b133/users/b895e01d4f1c415bb71b4e4798eed8cf/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:48.513868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.514152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.514423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.532023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] MFA Rules not processed for user `9a64aa8923254d36b4421f4583209172`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:48.533276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:48.542149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] MFA Rules not processed for user `702b4d2486164e53aba011979543e768`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:48.543336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:48.604655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:48.613254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1174/2368] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:48.613254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.633104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1195/2369] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:48.634216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.635586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:48.701431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28aece-70e5-4720-aa58-1d2db8571e77 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.706900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.707458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.707739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.708011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.708717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.710416 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.723066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1175/2370] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:48.723984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.725685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:48.726627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12977e6e-c3e6-4ef2-b6b0-6c20622892e3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.738075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.738768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.739048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.739315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.747293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.748915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.758341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1196/2371] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:48.759242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.769247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27bc24-d270-48b7-ab42-c1e707a0e903 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.774391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.774772 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.774926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.775461 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] PATH_INFO: `/v3/projects/1e18c39d593744579348bc69b546b133/users/b895e01d4f1c415bb71b4e4798eed8cf/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.778504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e18c39d593744579348bc69b546b133, user_id=b895e01d4f1c415bb71b4e4798eed8cf, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.781341 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34402ab-c682-4b41-8c6c-b29d30ea97e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.792199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77623ca-edec-4bf0-93a2-dc1b39788ee4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.796127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1197/2372] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:48 2022] PUT /identity/v3/projects/1e18c39d593744579348bc69b546b133/users/b895e01d4f1c415bb71b4e4798eed8cf/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:48.806472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.806762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.807038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.836323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] MFA Rules not processed for user `b895e01d4f1c415bb71b4e4798eed8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:48.837921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:48.848801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.849423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.849808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.850038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:48.872388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:48.914970 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1198/2373] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:48.922174 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:48.923668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:48.934381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1176/2374] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:48.978947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:48.994044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de29e8-e929-4f44-b5bb-d15215df6707 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:48.997931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:48.998544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:48.998822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:48.999096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.009131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.010729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7954da0-60bb-4379-86da-672d26539c6b service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.022822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1199/2375] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:49.053318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.061510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:49.155177 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749c2f2-f9d8-4633-82ad-d9f846b539ac service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.160252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.160887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.161171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.161444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] PATH_INFO: `/v3/users/73ff3ab22a6d4f4092a1870aee313320` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.162859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ff3ab22a6d4f4092a1870aee313320)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.165340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.241513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ff3ab22a6d4f4092a1870aee313320'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.242345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ff3ab22a6d4f4092a1870aee313320'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.257497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ff3ab22a6d4f4092a1870aee313320'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.265476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ff3ab22a6d4f4092a1870aee313320'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.266164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ff3ab22a6d4f4092a1870aee313320'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.290035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1177/2376] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:49 2022] DELETE /identity/v3/users/73ff3ab22a6d4f4092a1870aee313320 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:49.295638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.296087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.296400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.318384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:49.319627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.391520 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1200/2377] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:49.395862 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.397424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.448578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.450095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.458842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cba2d-a904-467c-b017-55fcb1abfc9c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.462477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.463074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.463349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.463617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.463715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139abaf-603b-4dee-a2d0-35ed42e3691b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.468272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.468893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.469183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.469580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] PATH_INFO: `/v3/users/929d7e0142864e97a9337a9fdf5cf784` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.471306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=929d7e0142864e97a9337a9fdf5cf784)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.473198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.473313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.474611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba464c-a545-45ae-879c-a4eb0cf7ff3a service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.484148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1178/2378] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:49.522543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929d7e0142864e97a9337a9fdf5cf784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.523403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929d7e0142864e97a9337a9fdf5cf784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.536756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929d7e0142864e97a9337a9fdf5cf784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.537488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929d7e0142864e97a9337a9fdf5cf784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.544453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929d7e0142864e97a9337a9fdf5cf784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.557929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1201/2379] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:49 2022] DELETE /identity/v3/users/929d7e0142864e97a9337a9fdf5cf784 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:49.562540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.562824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.563099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.582498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:49.583700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.602579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:49.647247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1179/2380] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:49.656604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.658657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.691703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:49.724020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693b3c-84ef-4db3-a79b-45f06e54a54b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.727705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.729395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.729395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.730489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.740491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.741971 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.752751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1202/2381] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:49.768615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.770226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:49.787033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5b18f-8d20-4a13-a8c4-4d838acd5e02 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.792235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.793202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.793202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.793392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] PATH_INFO: `/v3/projects/d80046d265a04224b3e0e3ee7e875400` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.794975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80046d265a04224b3e0e3ee7e875400)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.797149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:49.849198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80046d265a04224b3e0e3ee7e875400', 'request_id': 'req-50b48a44-ccea-40b2-9569-4431aee73004'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.855694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80046d265a04224b3e0e3ee7e875400', 'request_id': 'req-50b48a44-ccea-40b2-9569-4431aee73004'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.863241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80046d265a04224b3e0e3ee7e875400', 'request_id': 'req-50b48a44-ccea-40b2-9569-4431aee73004'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.874986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] The token cache is being invalidate because project d80046d265a04224b3e0e3ee7e875400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:49.875277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.875959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:49.878451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1180/2382] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:49 2022] DELETE /identity/v3/projects/d80046d265a04224b3e0e3ee7e875400 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:49.883119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:49.893525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b50-8725-4cc1-9e51-1928904d9820 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:49.957759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:49.958399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:49.958780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:49.959107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] PATH_INFO: `/v3/users/b895e01d4f1c415bb71b4e4798eed8cf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:49.960344 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b895e01d4f1c415bb71b4e4798eed8cf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:49.962357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.012010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b895e01d4f1c415bb71b4e4798eed8cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.012723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b895e01d4f1c415bb71b4e4798eed8cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.030386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b895e01d4f1c415bb71b4e4798eed8cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.031228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b895e01d4f1c415bb71b4e4798eed8cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.038987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b895e01d4f1c415bb71b4e4798eed8cf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.039969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.041561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.053476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1203/2383] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:49 2022] DELETE /identity/v3/users/b895e01d4f1c415bb71b4e4798eed8cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:50.056780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b48a44-ccea-40b2-9569-4431aee73004 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.123340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.124004 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.124319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.124595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] PATH_INFO: `/v3/projects/a6c583b60a07481b968554197dfd7a6f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.125854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c583b60a07481b968554197dfd7a6f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.128629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.182377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c583b60a07481b968554197dfd7a6f', 'request_id': 'req-f32b1e66-1550-4bd2-be10-87df9505ebd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.183571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:50.190707 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c583b60a07481b968554197dfd7a6f', 'request_id': 'req-f32b1e66-1550-4bd2-be10-87df9505ebd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.205014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c583b60a07481b968554197dfd7a6f', 'request_id': 'req-f32b1e66-1550-4bd2-be10-87df9505ebd5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.217436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] The token cache is being invalidate because project a6c583b60a07481b968554197dfd7a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:50.217800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.218475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.220592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1181/2384] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:50 2022] DELETE /identity/v3/projects/a6c583b60a07481b968554197dfd7a6f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:50.225175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.227065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.241726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419b02-68ca-45b1-b5ab-9c1fe2b7f399 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.299448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:50.312493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.313491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.314194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.314686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] PATH_INFO: `/v3/users/702b4d2486164e53aba011979543e768` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.317117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702b4d2486164e53aba011979543e768)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.320423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.383605 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.384935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.399667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702b4d2486164e53aba011979543e768'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.402441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b1e66-1550-4bd2-be10-87df9505ebd5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.410591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702b4d2486164e53aba011979543e768'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.413836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.414771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.415145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.415500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] PATH_INFO: `/v3/projects/1e18c39d593744579348bc69b546b133` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.416692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e18c39d593744579348bc69b546b133)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.419329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.448987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702b4d2486164e53aba011979543e768'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.450249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702b4d2486164e53aba011979543e768'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.461779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1151ee71-8286-4ad0-92b9-f0d4a5b75da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702b4d2486164e53aba011979543e768'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.484506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1204/2385] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:50 2022] DELETE /identity/v3/users/702b4d2486164e53aba011979543e768 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:50.511033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e18c39d593744579348bc69b546b133', 'request_id': 'req-32ec4281-59f4-473e-81b9-4c756d7454eb'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.518317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e18c39d593744579348bc69b546b133', 'request_id': 'req-32ec4281-59f4-473e-81b9-4c756d7454eb'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.527047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e18c39d593744579348bc69b546b133', 'request_id': 'req-32ec4281-59f4-473e-81b9-4c756d7454eb'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.544296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] The token cache is being invalidate because project 1e18c39d593744579348bc69b546b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:50.544918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.545610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-32ec4281-59f4-473e-81b9-4c756d7454eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:50.547439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1182/2386] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:50 2022] DELETE /identity/v3/projects/1e18c39d593744579348bc69b546b133 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:50.552676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.553160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.553627 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.576000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:50.577296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.669380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1205/2387] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:50.678347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.678693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.678970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.703563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:50.704910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.714045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1183/2388] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:50.718638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.741994 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344e4b-a9dc-4d4d-ad3a-0e11a70d638a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.748645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.749362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.749887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.750529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.751557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:50.751557 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.753448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.772004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1206/2389] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:50.776543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.786635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c764ea-c95a-4140-a3ef-1d2c7ec7d19b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.791611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.792375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.792725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.793279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.793776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.795915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.828235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1184/2390] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:50 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:50.832785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.843040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f871d-a719-427f-b202-986f37903c30 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.896782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:50.903898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.904701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.905440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.905899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.906613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.909428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.930917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1207/2391] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:50 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:50.935195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.945560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c577eec-ec5f-4dda-b292-44efcf7647ff admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.950239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.950831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.951108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.951380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.952014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.953661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.964972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1185/2392] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:50.968697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.979698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b60e3-de0c-4caf-9eb6-26b89af1d278 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:50.983709 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:50.985360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:50.985608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:50.986207 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:50.986594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:50.986958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:50.987711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:50.989559 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:50.999208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6776e11-09f8-478c-a3a4-8379b8779cfe admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.003774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1208/2393] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:51.007742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.008106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.008429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.008711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.008976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] PATH_INFO: `/v3/projects/75737c953a084942b88232832039c6ff` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.010256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75737c953a084942b88232832039c6ff)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.012213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.020976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f124-023c-4aef-a438-06bae2c226cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.026085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.026739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.027016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.027283 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] PATH_INFO: `/v3/projects/0643880d82e7412cb1e297f85c28671f/users/55c8ee89e96447bf80621ec81fe428df/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.043377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0643880d82e7412cb1e297f85c28671f, user_id=55c8ee89e96447bf80621ec81fe428df, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.046122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed305a-2e78-47f7-b144-000e0b05df50 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.059009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1209/2394] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:51 2022] PUT /identity/v3/projects/0643880d82e7412cb1e297f85c28671f/users/55c8ee89e96447bf80621ec81fe428df/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:51.062269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75737c953a084942b88232832039c6ff', 'request_id': 'req-6712376d-4140-4904-b7ea-3596c9d43e43'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:51.068186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75737c953a084942b88232832039c6ff', 'request_id': 'req-6712376d-4140-4904-b7ea-3596c9d43e43'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:51.070340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.070869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.071219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.076032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75737c953a084942b88232832039c6ff', 'request_id': 'req-6712376d-4140-4904-b7ea-3596c9d43e43'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:51.088690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] The token cache is being invalidate because project 75737c953a084942b88232832039c6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:51.089032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:51.089693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6712376d-4140-4904-b7ea-3596c9d43e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:51.091210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1186/2395] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:50 2022] DELETE /identity/v3/projects/75737c953a084942b88232832039c6ff => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:51.096617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fee2b-f135-43fa-a43f-f1734303f918 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.096948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fee2b-f135-43fa-a43f-f1734303f918 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.097224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fee2b-f135-43fa-a43f-f1734303f918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.100532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] MFA Rules not processed for user `55c8ee89e96447bf80621ec81fe428df`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.101803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.105489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=17,keystone:SELECT=79,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:51.116883 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e49fee2b-f135-43fa-a43f-f1734303f918 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.118474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e49fee2b-f135-43fa-a43f-f1734303f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.167300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1210/2396] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:51.171538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.172848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.179000 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1187/2397] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:51.186761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.187025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284ec3-4f69-416a-b6f6-77f0ac553283 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.187150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.187301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.191710 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.192357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.192641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.192919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.193534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.195462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.206735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.207935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.216802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1188/2398] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:51.221803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.226989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1211/2399] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:51.230631 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.233734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a5517-bc45-4599-9cf5-96b733c1fa73 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.291285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.291891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.292255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.292533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.293169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:51.293474 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.295074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.296045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d40b-ac7f-410f-be97-11e6f361e2f1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.301313 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.302402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.302680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.302948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.303998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.305975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.306660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1189/2400] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:51.311108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.323372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fdf0-6c25-4eb7-a4db-b7cb9b5dc8c0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.331085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1212/2401] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:51.331235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.331235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.331235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.331235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.331623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.332262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.332509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.341989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529bacd-00b4-4008-bb55-58cfbc81cd0a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.347113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.347703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.347984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.348323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.348940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.350644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.352978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:51.360188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1190/2402] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/projects => generated 351 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:51.364454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.365677 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1213/2403] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:46:51.369153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.379224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9c8d-fc9c-4085-8194-c28dd4d566da admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.429280 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac6cb-dfa3-4fac-8f5f-ee3408e44e10 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.435575 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.436221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.436539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.436761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.437367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.438227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.439355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.439751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.439873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.440032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.440705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.442732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.453650 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1214/2404] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:51.458819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.458966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:51.467730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1191/2405] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/users => generated 276 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:51.469228 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.471865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64e6e-72f7-4dda-8a34-b9b4964fc8fa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.476493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.477138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.477419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.477707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] PATH_INFO: `/v3/projects/b21868b340a14c5994771d5e17896b9b/users/013f19aa9e054c60aa82e7f2fbd618e9/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.479607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d0f21-b4ba-4aad-9187-fc2b30ce9978 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.484635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.485411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.485705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.485978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.486624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.488252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.492833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21868b340a14c5994771d5e17896b9b, user_id=013f19aa9e054c60aa82e7f2fbd618e9, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.495566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d8f81-c125-492e-8204-ef05479d5ee7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.498391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1192/2406] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:51.503265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.510158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1215/2407] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:51 2022] PUT /identity/v3/projects/b21868b340a14c5994771d5e17896b9b/users/013f19aa9e054c60aa82e7f2fbd618e9/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:51.513322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6091ce-ac8d-4502-9a19-dc60b239797e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.520687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.520976 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.521244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.548336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] MFA Rules not processed for user `013f19aa9e054c60aa82e7f2fbd618e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.549575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.571623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.572288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.572567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.572842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.573480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.575214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.585533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1193/2408] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:46:51.589703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.599534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd9b9-1865-4919-92ff-032241dc8b65 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.604321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.604954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.605398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.605675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] PATH_INFO: `/v3/projects/545437c65052406cb5084e873e5b34d1/users/c1eb40047d834fdab7486d7d4946cbe0/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.620217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=545437c65052406cb5084e873e5b34d1, user_id=c1eb40047d834fdab7486d7d4946cbe0, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.620674 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1216/2409] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:51.623223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219ab92-d462-463a-8f16-6bf060a1dfeb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.625030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.636640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d61e2b-b184-44ca-a1e1-3fa8344d32dd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.637829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1194/2410] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:51 2022] PUT /identity/v3/projects/545437c65052406cb5084e873e5b34d1/users/c1eb40047d834fdab7486d7d4946cbe0/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:51.648705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.648996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.649276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.676427 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] MFA Rules not processed for user `c1eb40047d834fdab7486d7d4946cbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.677643 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.694136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.694683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.694963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.695233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.695876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.697796 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.702223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:51.729160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1217/2411] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:46:51.733247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.749611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1195/2412] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:51.750669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.761803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3438fe2-bd72-4f80-b6cc-f1b3e06ae074 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.802556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae65b9-9c61-4302-9973-2c366e999a3a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.807538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.808263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.808543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.809007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.809788 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.811718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.820931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:51.842481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1218/2413] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:51.844998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.865396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.866066 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.866346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.866716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.867283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.868628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ffdc-662c-4e89-a286-ea52037ec0eb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:51.871249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.881779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:51.882657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.882962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.883231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.883877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:51.885485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59becd-684a-4f20-a329-ccb5222ae7ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:51.906435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1219/2414] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:51.908479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:51.908947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:51.909094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:51.923489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1196/2415] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/projects => generated 355 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:51.928173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:51.946811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:51.948214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:51.994828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de563455-ecb0-4aaa-94c1-17083bb6d465 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.000151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.000786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.001637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.001946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] PATH_INFO: `/v3/projects/3ee45a39a6d54900bd1a90b923659939/users/4b03cb99925f4452a816e85dbb889b91/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.016787 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1220/2416] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:52.017521 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.023665 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee45a39a6d54900bd1a90b923659939, user_id=4b03cb99925f4452a816e85dbb889b91, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.030140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73e018-5d29-46f0-8e55-f7f06030f759 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.032658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.035205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.035941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.036836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.036836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.037428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.039817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.049139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1197/2417] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:51 2022] PUT /identity/v3/projects/3ee45a39a6d54900bd1a90b923659939/users/4b03cb99925f4452a816e85dbb889b91/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:52.050084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.057043 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:52.068890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1221/2418] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:52 2022] POST /identity/v3/users => generated 284 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:52.069778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.080148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56321c-6835-42d6-b6bb-d2c6f0dc7b8c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.131077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:52.137197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a0f97-af36-4bfa-b1f0-eb5c6b0a8471 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.142447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.143138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.143256 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.143422 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.143692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.143804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.144090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.144371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.144518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.145964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.159577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1222/2419] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:52.159577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.166775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf441-bed8-4fd0-ba7d-1383da100a2a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.171365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.171938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.172252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.172523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.173704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.175254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.185756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1223/2420] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:52.187636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.197675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edd376-41b9-4603-a005-ca198bb40145 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.202459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.203107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.203390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.203739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] PATH_INFO: `/v3/projects/3ee45a39a6d54900bd1a90b923659939/users/4b03cb99925f4452a816e85dbb889b91/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.205634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.205835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee45a39a6d54900bd1a90b923659939, user_id=4b03cb99925f4452a816e85dbb889b91, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.207233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.208481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9fa3e-ee0e-4c7f-9a64-bd3143119113 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.212082 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:52.217257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1198/2421] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:46:52.218016 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.228876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1224/2422] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:52 2022] PUT /identity/v3/projects/3ee45a39a6d54900bd1a90b923659939/users/4b03cb99925f4452a816e85dbb889b91/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:52.235058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba969ee-e16e-462f-b66f-f74ef9794749 service swift] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.239696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.239983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.240292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.271090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] MFA Rules not processed for user `4b03cb99925f4452a816e85dbb889b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:52.272228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:52.300556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.300996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.301278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.301578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] PATH_INFO: `/v3/projects/90b624ab4e804da091b5fe9e50af1746/users/ccd5d368d6ad45a6970ab8953739bc3f/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.318039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b624ab4e804da091b5fe9e50af1746, user_id=ccd5d368d6ad45a6970ab8953739bc3f, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.321514 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.336184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1199/2423] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:52 2022] PUT /identity/v3/projects/90b624ab4e804da091b5fe9e50af1746/users/ccd5d368d6ad45a6970ab8953739bc3f/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:52.340008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.353592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1225/2424] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:52.365172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.366693 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:52.411054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa003f2-c716-47a7-b633-5d860a0ae010 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.419104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.419888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.420301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.420747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.421455 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.423901 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.434472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1200/2425] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:52.438752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.443896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40aeda-d962-458e-8fed-74bf8770886e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.448796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e20ba1-1ed1-4bd2-812a-39dc66312964 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.453764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.454935 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.455209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.455503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] PATH_INFO: `/v3/projects/90b624ab4e804da091b5fe9e50af1746/users/ccd5d368d6ad45a6970ab8953739bc3f/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.457670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b624ab4e804da091b5fe9e50af1746, user_id=ccd5d368d6ad45a6970ab8953739bc3f, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.460321 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916dd0a-aaad-447c-81bf-157c2896dc47 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.472428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1201/2426] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:52 2022] PUT /identity/v3/projects/90b624ab4e804da091b5fe9e50af1746/users/ccd5d368d6ad45a6970ab8953739bc3f/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:52.484327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.484642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.484922 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.502582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.503223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.503502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.503779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.519850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] MFA Rules not processed for user `ccd5d368d6ad45a6970ab8953739bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:52.521087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:52.526943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:52.577730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:52.579878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.581490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.591782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1226/2427] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:46:52.600864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1202/2428] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:52.615708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.617872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:52.634435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364eea-1c10-4568-9683-225ea9a764a7 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.640713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.688413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.689065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.689347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.689754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.698323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7447f0a-f872-4ae5-8dab-29b2b352b6f3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.699386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.700785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.702100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.702693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.702969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.703240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.710726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1227/2429] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:52.771377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.772930 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.790158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1203/2430] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:46:52.796334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:52.805662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07feb7-cb2f-44ec-844f-85112de1935c service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:52.809419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:52.810016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:52.810294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:52.810563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:52.879659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:52.881105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349b65-3cd7-4ec4-98fb-b5b8bbb121a6 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:52.890530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1228/2431] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:54.365212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:54.366695 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:54.434076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d690-3de1-4fba-bb34-55e5c0c0f076 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:54.438496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:54.439114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:54.439733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:54.440007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] PATH_INFO: `/v3/users/9a64aa8923254d36b4421f4583209172` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:54.441139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a64aa8923254d36b4421f4583209172)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:54.443072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:54.492209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a64aa8923254d36b4421f4583209172'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:54.492858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a64aa8923254d36b4421f4583209172'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:54.494579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:54.502243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a64aa8923254d36b4421f4583209172'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:54.510327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a64aa8923254d36b4421f4583209172'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:54.511001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a64aa8923254d36b4421f4583209172'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:54.528518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1204/2432] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:54 2022] DELETE /identity/v3/users/9a64aa8923254d36b4421f4583209172 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:54.533665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:54.534154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:54.534249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:54.554289 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:54.555477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:54.605462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:54.618636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1229/2433] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:54.631988 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:54.633703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:54.694802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8a8c-90ae-4799-9dc4-d022e6bc8c2a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:54.698692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:54.699308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:54.699593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:54.699864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:54.709436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:54.710915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1022e-fef8-472c-8fdd-918c5b1eae12 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:54.721431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1205/2434] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:54.987583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:54.989094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.002958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94d22-dac0-4337-928f-30836c273c97 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.008533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.009827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.010187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.010519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] PATH_INFO: `/v3/projects/53a80129987745a391bf8a0b2e77b22a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.011729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a80129987745a391bf8a0b2e77b22a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.013799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.064997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a80129987745a391bf8a0b2e77b22a', 'request_id': 'req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.070547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a80129987745a391bf8a0b2e77b22a', 'request_id': 'req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.076797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a80129987745a391bf8a0b2e77b22a', 'request_id': 'req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.089657 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] The token cache is being invalidate because project 53a80129987745a391bf8a0b2e77b22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:55.089975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.090593 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5429ef8c-b0b0-4836-8da9-5de22f5f9dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.092087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1230/2435] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:54 2022] DELETE /identity/v3/projects/53a80129987745a391bf8a0b2e77b22a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:55.097481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.097763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.098032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.117663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:55.118850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.176018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1206/2436] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:55.183818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.184236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.184519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.204156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:55.205968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.214130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1231/2437] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:55.218022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.228185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c5fca-602c-4c26-97b0-36fa39a0155a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.232888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.233408 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.233689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.233969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.234606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:55.234908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.236765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.248770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1207/2438] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:55.253164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.263077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353573b-a60d-4d44-b373-a5ba2ebeb640 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.268795 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.269440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.269722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.270032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.270958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.273293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.302636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1232/2439] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:55.306705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.317332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6601e-79a2-4c2a-bbec-221fa1dc58e4 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.366484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:55.374166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.374773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.375517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.375858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.376576 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.379304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.402725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1208/2440] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:55.406981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.417777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed55d6-231c-4792-a3dd-522d23f4d197 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.422630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.423310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.424184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.424533 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.425245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.426907 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.436881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1233/2441] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:55.441777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.451593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5f93-b90a-4178-a0da-f9e9eff3ed3b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.456366 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.456955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.457233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.457507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.458138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.459730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba2047-bda2-4538-a266-b13a6c5f4203 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.473796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1209/2442] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:46:55.474984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.485428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79e67-e6c7-4d24-aae4-e51acf88bf84 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.490864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.491589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.492020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.492395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] PATH_INFO: `/v3/projects/b8b24d9cb13e473c92a0b136edb54e0d/users/ba8734438e0f4964b32b1f49097afab2/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.513468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b24d9cb13e473c92a0b136edb54e0d, user_id=ba8734438e0f4964b32b1f49097afab2, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.517099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.531440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1234/2443] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:55 2022] PUT /identity/v3/projects/b8b24d9cb13e473c92a0b136edb54e0d/users/ba8734438e0f4964b32b1f49097afab2/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:55.542619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.542906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.543175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.583767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] MFA Rules not processed for user `ba8734438e0f4964b32b1f49097afab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:55.584518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.653733 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1210/2444] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:55.658244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.725320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3081a-3d16-44ac-9b42-5aaef9866123 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.730008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.730616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.730890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.731162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.731781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.733818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.758022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:55.767300 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1235/2445] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:55.771244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.782541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f22d-e6ba-4a42-8256-1236730cc491 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.792342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.794591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.844143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.844680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.844957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.845226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.846682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.848666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.858142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3278-c163-4e23-8518-3bcc052608b1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.863506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.864287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.864668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.865040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] PATH_INFO: `/v3/users/55c8ee89e96447bf80621ec81fe428df` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.866327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c8ee89e96447bf80621ec81fe428df)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.868380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.870331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1211/2446] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:55.874155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.884343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a09a7-e74e-4d0c-a78c-32abb58c285c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.888896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.889472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.889745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.890012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.890634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.892234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.902661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1212/2447] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:46:55.906955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.917547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80779d-c117-4e32-ad2b-ee7a9b8e2193 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:55.918066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c8ee89e96447bf80621ec81fe428df'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.918824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c8ee89e96447bf80621ec81fe428df'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.922195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:55.922875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.923156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.923428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] PATH_INFO: `/v3/projects/f62f813b7d604a18905bc6613f701bca/users/8281900ef5b34109ae3ede97a30a226b/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.932028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c8ee89e96447bf80621ec81fe428df'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.932729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c8ee89e96447bf80621ec81fe428df'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.939033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62f813b7d604a18905bc6613f701bca, user_id=8281900ef5b34109ae3ede97a30a226b, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:55.940402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae309a7c-f60a-4392-86d5-a67fcade06b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c8ee89e96447bf80621ec81fe428df'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:55.941726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:55.953085 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1236/2448] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:55 2022] DELETE /identity/v3/users/55c8ee89e96447bf80621ec81fe428df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:55.954479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1213/2449] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:55 2022] PUT /identity/v3/projects/f62f813b7d604a18905bc6613f701bca/users/8281900ef5b34109ae3ede97a30a226b/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:55.957663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:55.957947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:55.958133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:55.958267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:55.959747 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.976960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:55.978139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:55.979766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:56.030297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fa57-6868-4bb2-9814-c4b56231a44b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.039444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1237/2450] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:46:56.049754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.051103 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:56.072911 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:56.087820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.088467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.088736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.089008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.089637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.091216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.101545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1214/2451] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:46:56.105509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.110803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dce3de-9c33-4e2a-acbe-01409d5bd31b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.115068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.115606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579f0d-d291-45f9-9320-70e1e928585d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.115734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.115933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.116238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.120165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.120779 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.121057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.121331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] PATH_INFO: `/v3/projects/f62f813b7d604a18905bc6613f701bca/users/8281900ef5b34109ae3ede97a30a226b/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.123208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62f813b7d604a18905bc6613f701bca, user_id=8281900ef5b34109ae3ede97a30a226b, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.125200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.125829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39424-7f9a-41a1-ad7c-a90527f68c8f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.126619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.136764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1215/2452] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:56 2022] PUT /identity/v3/projects/f62f813b7d604a18905bc6613f701bca/users/8281900ef5b34109ae3ede97a30a226b/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:46:56.139663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1238/2453] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:56.147319 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.147625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.147897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.175533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] MFA Rules not processed for user `8281900ef5b34109ae3ede97a30a226b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:56.176810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:56.246612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1216/2454] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:56.259477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.260985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:56.322476 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e556dc-96ca-4108-b039-fcccc988a415 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.371432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.372042 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.372355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.372632 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.382547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.383964 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.393744 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1239/2455] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:56.413086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.414620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:56.455147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:56.477670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.486742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53feaa-54a9-438d-8d25-14d256b133af service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.488134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9a55c-3913-4eaa-86d1-0dceb269991e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.491177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.491874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.492274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.492615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.492727 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.493246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.493553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.493824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] PATH_INFO: `/v3/projects/0643880d82e7412cb1e297f85c28671f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.494727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:56.494948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0643880d82e7412cb1e297f85c28671f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.496910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.546374 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0643880d82e7412cb1e297f85c28671f', 'request_id': 'req-596bae92-7e52-48f5-a7ac-60e93f91b950'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.552813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0643880d82e7412cb1e297f85c28671f', 'request_id': 'req-596bae92-7e52-48f5-a7ac-60e93f91b950'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.555598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.557145 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.560723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0643880d82e7412cb1e297f85c28671f', 'request_id': 'req-596bae92-7e52-48f5-a7ac-60e93f91b950'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.566753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1240/2456] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:46:56.573259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] The token cache is being invalidate because project 0643880d82e7412cb1e297f85c28671f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:56.573553 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.574188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.575666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1217/2457] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:56 2022] DELETE /identity/v3/projects/0643880d82e7412cb1e297f85c28671f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:56.579666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:56.590427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a1c7-3b13-47ac-b995-14e24246d911 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:56.606916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:56.653068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:56.653720 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:56.654024 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:56.654335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] PATH_INFO: `/v3/users/013f19aa9e054c60aa82e7f2fbd618e9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:56.655738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013f19aa9e054c60aa82e7f2fbd618e9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:56.658086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:56.732100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013f19aa9e054c60aa82e7f2fbd618e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.733905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013f19aa9e054c60aa82e7f2fbd618e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.746009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013f19aa9e054c60aa82e7f2fbd618e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.747229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013f19aa9e054c60aa82e7f2fbd618e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.762036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013f19aa9e054c60aa82e7f2fbd618e9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:56.770842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1241/2458] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:56 2022] DELETE /identity/v3/users/013f19aa9e054c60aa82e7f2fbd618e9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:57.044997 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:57.046618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:57.064160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bae92-7e52-48f5-a7ac-60e93f91b950 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:57.128611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:57.129362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.129705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.130042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] PATH_INFO: `/v3/projects/b21868b340a14c5994771d5e17896b9b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.131212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21868b340a14c5994771d5e17896b9b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:57.133523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:57.186343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21868b340a14c5994771d5e17896b9b', 'request_id': 'req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.192703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21868b340a14c5994771d5e17896b9b', 'request_id': 'req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.200587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21868b340a14c5994771d5e17896b9b', 'request_id': 'req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.202051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:57.214338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] The token cache is being invalidate because project b21868b340a14c5994771d5e17896b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:57.214641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.215811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.217507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1218/2459] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:57 2022] DELETE /identity/v3/projects/b21868b340a14c5994771d5e17896b9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:57.221857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:57.223478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:57.237179 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338de0-d80d-4707-b04a-dcfbb1146f83 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:57.297046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:57.297705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.297984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.298268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] PATH_INFO: `/v3/users/4b03cb99925f4452a816e85dbb889b91` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.300096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b03cb99925f4452a816e85dbb889b91)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:57.302229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:57.346001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:57.352374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b03cb99925f4452a816e85dbb889b91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.353106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b03cb99925f4452a816e85dbb889b91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.366106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b03cb99925f4452a816e85dbb889b91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.366839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b03cb99925f4452a816e85dbb889b91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.373692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46385dc9-0738-40a7-8c87-2f1086c42e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b03cb99925f4452a816e85dbb889b91'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.385743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1242/2460] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:46:57 2022] DELETE /identity/v3/users/4b03cb99925f4452a816e85dbb889b91 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:57.654986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:57.656383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:57.669708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bf40e-dae5-4e3a-bfb0-8486cc69729d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:57.731444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:57.732372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.732734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.733046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] PATH_INFO: `/v3/projects/3ee45a39a6d54900bd1a90b923659939` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.734206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee45a39a6d54900bd1a90b923659939)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:57.737057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:57.790364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee45a39a6d54900bd1a90b923659939', 'request_id': 'req-b1a1c55d-3779-406e-bfe4-db190942dfdf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.797938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee45a39a6d54900bd1a90b923659939', 'request_id': 'req-b1a1c55d-3779-406e-bfe4-db190942dfdf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.805947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee45a39a6d54900bd1a90b923659939', 'request_id': 'req-b1a1c55d-3779-406e-bfe4-db190942dfdf'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.816902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] The token cache is being invalidate because project 3ee45a39a6d54900bd1a90b923659939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:46:57.817195 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.817942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b1a1c55d-3779-406e-bfe4-db190942dfdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:46:57.819589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1219/2461] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:46:57 2022] DELETE /identity/v3/projects/3ee45a39a6d54900bd1a90b923659939 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:57.825470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.825931 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.826152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.846600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:57.847802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:57.907681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1243/2462] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:57.917524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664260-1665-49fc-a029-e832e169c460 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.917812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664260-1665-49fc-a029-e832e169c460 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.918114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664260-1665-49fc-a029-e832e169c460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.938331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1c664260-1665-49fc-a029-e832e169c460 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:57.939556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1c664260-1665-49fc-a029-e832e169c460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:57.947666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1220/2463] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:57.951878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:57.962444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc4f71-518b-42c1-9145-4411fef044c2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:57.967082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:57.967687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:57.967967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:57.968272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:57.968916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:46:57.969225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:57.971485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:57.983784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1244/2464] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:46:57.988593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664260-1665-49fc-a029-e832e169c460 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:57.998745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664260-1665-49fc-a029-e832e169c460 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.003611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.004246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.004565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.004983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.005852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.008231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.040513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1221/2465] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:57 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:58.048238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.055595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f2a6e-2f76-46b0-8274-56905dac65cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.124015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.124698 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.125220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.125346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.126031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.128570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.151136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1245/2466] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:58 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:58.155306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.165810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0490d-3b0c-421d-b41f-0374130d9a89 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.170349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.170962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.171237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.171506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.172159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.173982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.184534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1222/2467] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:58.188333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.198639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41a6d2-9f07-4475-a4fd-dbe77286fb44 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.203282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.203955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.204340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.204705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.205910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.207551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b6707-6401-4527-a0a0-721d22eb7880 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.218105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1246/2468] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:58.222040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.232765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b52d-74ac-42f9-beb1-2a966ca1fb30 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.237759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.238262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.238543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.238816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] PATH_INFO: `/v3/projects/4b761a5cdf0a457aa5a7d5858ba4ffba/users/26321f37127f4337be879dab1e839206/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.255985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b761a5cdf0a457aa5a7d5858ba4ffba, user_id=26321f37127f4337be879dab1e839206, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.259131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.276621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1223/2469] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:58 2022] PUT /identity/v3/projects/4b761a5cdf0a457aa5a7d5858ba4ffba/users/26321f37127f4337be879dab1e839206/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:58.287803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.288025 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.288321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.316551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] MFA Rules not processed for user `26321f37127f4337be879dab1e839206`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:58.317773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:58.329554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:58.398808 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1247/2470] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:58.403229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.425961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:58.468405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ea034-ba80-428a-ab4f-0a9324588e74 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.473070 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.473668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.473951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.474221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.474841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.476802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.503456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1224/2471] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:46:58 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:58.508125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.518807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf6b8-89eb-45bd-81d8-7cea32edf222 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.573756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.574354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.574637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.574910 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.575518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.577446 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.598671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1248/2472] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:46:58 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:46:58.602674 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.613739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2f7a-4e9c-487a-a5ea-a443a07cccae admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.618942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.619770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.620080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.620359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.621002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.622791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.634205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1225/2473] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:58.638227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.648065 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5d94-d606-431a-b18b-01d5c07bfe4b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.652652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.653297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.653577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.653850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] PATH_INFO: `/v3/projects/db09831794e44c4a8bff64a05fd096dc/users/b0eb7ef8e56c40009bb7ca354d6020d7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.668825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db09831794e44c4a8bff64a05fd096dc, user_id=b0eb7ef8e56c40009bb7ca354d6020d7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.671480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.684351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1249/2474] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:58 2022] PUT /identity/v3/projects/db09831794e44c4a8bff64a05fd096dc/users/b0eb7ef8e56c40009bb7ca354d6020d7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:58.688222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.698734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f45141-5d3e-4786-a407-b1a74f5a27a8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.755027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.755635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.755919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.756255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.756889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.758746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf3e2a-48ad-4c0a-82eb-0d5a2b2d7c8a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.768517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1226/2475] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:46:58.772666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.782974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef8b5-b764-4709-a1b4-f630b3c4b35b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.787508 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.788189 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.788469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.788742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] PATH_INFO: `/v3/projects/db09831794e44c4a8bff64a05fd096dc/users/b0eb7ef8e56c40009bb7ca354d6020d7/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.790638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db09831794e44c4a8bff64a05fd096dc, user_id=b0eb7ef8e56c40009bb7ca354d6020d7, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.793304 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:58.804315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1250/2476] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:46:58 2022] PUT /identity/v3/projects/db09831794e44c4a8bff64a05fd096dc/users/b0eb7ef8e56c40009bb7ca354d6020d7/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:46:58.815110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.815567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.815950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.842843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] MFA Rules not processed for user `b0eb7ef8e56c40009bb7ca354d6020d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:46:58.844085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:58.909543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1227/2477] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:46:58.920865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:58.922607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:46:58.979019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8314e-3a17-44fc-a5a6-5d61634bb690 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:58.982574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:58.983172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:58.983449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:58.983721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:58.993097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:58.994504 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:59.003765 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1251/2478] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:46:59.084568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:46:59.093986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4cd1-8486-43ea-976c-f6834dca4360 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:46:59.097987 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:46:59.098570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:46:59.098845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:46:59.099114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:46:59.117287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:46:59.164350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:46:59.165827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba59253-f331-44b1-8240-6d85871fc927 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:46:59.175324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1228/2479] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:04.104399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:04.114949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:04.166417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd506a-1d68-410a-895b-1430a65fe5f4 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:04.170827 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:04.171447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:04.171726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:04.171996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] PATH_INFO: `/v3/users/26321f37127f4337be879dab1e839206` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:04.173120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26321f37127f4337be879dab1e839206)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:04.175578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:04.222886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26321f37127f4337be879dab1e839206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.223589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26321f37127f4337be879dab1e839206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.235495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26321f37127f4337be879dab1e839206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.236163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26321f37127f4337be879dab1e839206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.243993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26321f37127f4337be879dab1e839206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.256360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1252/2480] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:04 2022] DELETE /identity/v3/users/26321f37127f4337be879dab1e839206 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:04.261048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:04.261500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:04.261594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:04.281102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:04.282284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:04.338385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1229/2481] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:04.348575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:04.350120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:04.405818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d7081-adab-4f4f-8fa4-6b1f24d34ab1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:04.410088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:04.410690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:04.410969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:04.411238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:04.420196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:04.421605 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:04.431305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1253/2482] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:04.707289 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:04.708730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:04.725817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976dcf7-a964-49fb-a25a-24534bf86790 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:04.731613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:04.732410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:04.732717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:04.733093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] PATH_INFO: `/v3/projects/4b761a5cdf0a457aa5a7d5858ba4ffba` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:04.734591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b761a5cdf0a457aa5a7d5858ba4ffba)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:04.736164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:04.783534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b761a5cdf0a457aa5a7d5858ba4ffba', 'request_id': 'req-7afdbc1f-6e74-47a6-a537-f6065e462788'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.789468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b761a5cdf0a457aa5a7d5858ba4ffba', 'request_id': 'req-7afdbc1f-6e74-47a6-a537-f6065e462788'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.796826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b761a5cdf0a457aa5a7d5858ba4ffba', 'request_id': 'req-7afdbc1f-6e74-47a6-a537-f6065e462788'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.808470 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] The token cache is being invalidate because project 4b761a5cdf0a457aa5a7d5858ba4ffba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:04.808762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.809398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.810934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1230/2483] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:04 2022] DELETE /identity/v3/projects/4b761a5cdf0a457aa5a7d5858ba4ffba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:04.814925 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:04.825108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aded8-ea6f-4d46-8712-a3e30f233669 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:04.855610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:04.899052 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:04.899818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:04.900265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:04.900714 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] PATH_INFO: `/v3/users/b0eb7ef8e56c40009bb7ca354d6020d7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:04.902175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eb7ef8e56c40009bb7ca354d6020d7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:04.904247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:04.990169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eb7ef8e56c40009bb7ca354d6020d7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:04.991167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eb7ef8e56c40009bb7ca354d6020d7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.006893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eb7ef8e56c40009bb7ca354d6020d7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.007913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eb7ef8e56c40009bb7ca354d6020d7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.017707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc6c42e8-a4ed-4f68-a489-6fd229796b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eb7ef8e56c40009bb7ca354d6020d7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.044583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1254/2484] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:04 2022] DELETE /identity/v3/users/b0eb7ef8e56c40009bb7ca354d6020d7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:05.360112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.361908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:05.376946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdbc1f-6e74-47a6-a537-f6065e462788 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.423244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:05.448360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.448983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.449259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.449526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] PATH_INFO: `/v3/projects/db09831794e44c4a8bff64a05fd096dc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.450630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db09831794e44c4a8bff64a05fd096dc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.452859 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.498579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db09831794e44c4a8bff64a05fd096dc', 'request_id': 'req-784a3d83-7cb3-49ab-9986-810d7465e07a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.504291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db09831794e44c4a8bff64a05fd096dc', 'request_id': 'req-784a3d83-7cb3-49ab-9986-810d7465e07a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.511821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db09831794e44c4a8bff64a05fd096dc', 'request_id': 'req-784a3d83-7cb3-49ab-9986-810d7465e07a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.523578 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] The token cache is being invalidate because project db09831794e44c4a8bff64a05fd096dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:05.523866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.524521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-784a3d83-7cb3-49ab-9986-810d7465e07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:05.526030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1231/2485] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:05 2022] DELETE /identity/v3/projects/db09831794e44c4a8bff64a05fd096dc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:05.530840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.531317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.531416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.551083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:05.552534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:05.610195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1255/2486] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:05.617801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.618093 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.618367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.637951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:05.639130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:05.647452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1232/2487] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:05.651545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.661303 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ac14f-6003-46c0-9095-dd1573439bb8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.665840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.666431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.666717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.666993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.667637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:05.667945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.669602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.680903 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1256/2488] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:05.684974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.694680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109473ee-1d17-49fc-a7e0-c6eba88cfad3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.699332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.699914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.700224 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.700498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.701147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.703122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.731688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1233/2489] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:05.735851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.746513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b6b56-0c01-40e8-b50d-b9509496f75b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.780340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:05.805336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.805944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.806219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.806483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.807089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.809015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.829646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1257/2490] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:05.833764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.844118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b0160-46d6-4b96-a646-fbe4309e893e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.849240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.849827 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.850101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.850369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.850996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.852598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.864304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1234/2491] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:05.868268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.878144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b75c9-dd11-46da-85e8-4000b167ef04 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.883013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.883769 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.883877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.884197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.884836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.886421 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9501-f4c6-49a0-a4ef-821eae41718f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.896503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1258/2492] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:05.900430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:05.911019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146334e-d1e0-46e6-b3fb-8b27484161ec admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:05.915852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:05.916478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.916758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.917036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] PATH_INFO: `/v3/projects/cee05688cb0045e3b433d975cd5d3ae8/users/84d522a47f254bfca7be7d4e0b86c762/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.932772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee05688cb0045e3b433d975cd5d3ae8, user_id=84d522a47f254bfca7be7d4e0b86c762, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:05.935467 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:05.948353 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1235/2493] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:05 2022] PUT /identity/v3/projects/cee05688cb0045e3b433d975cd5d3ae8/users/84d522a47f254bfca7be7d4e0b86c762/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:05.958437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:05.958727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:05.959002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:05.985667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] MFA Rules not processed for user `84d522a47f254bfca7be7d4e0b86c762`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:05.986878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:06.050551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1259/2494] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:06.061506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:06.063192 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:06.118798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59804-d4c2-4301-a5ee-24d799eb9c28 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:06.122377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:06.122978 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.123259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.123535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.132667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:06.134072 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e6484-e40b-4f75-ba60-d0283b7a766d service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:06.142799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1236/2495] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:06.161154 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:06.222778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324158f7-d2ff-4b99-ba32-e4985b3e7eae None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:06.227308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:06.227948 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.228364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.228640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] PATH_INFO: `/v3/users/84d522a47f254bfca7be7d4e0b86c762` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.229786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d522a47f254bfca7be7d4e0b86c762)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:06.231708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:06.279471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d522a47f254bfca7be7d4e0b86c762'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.280157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d522a47f254bfca7be7d4e0b86c762'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.281278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:06.295049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d522a47f254bfca7be7d4e0b86c762'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.295855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d522a47f254bfca7be7d4e0b86c762'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.305060 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d522a47f254bfca7be7d4e0b86c762'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.318294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1260/2496] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:06 2022] DELETE /identity/v3/users/84d522a47f254bfca7be7d4e0b86c762 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:06.322798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.323101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.323379 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.337736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:06.344037 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:06.345705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:06.421210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1237/2497] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:06.433984 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:06.435886 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:06.519595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287ee7-1065-4d0c-ba66-e20a6911c762 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:06.529569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:06.530425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.530709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.531039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.543707 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:06.545534 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a0e06-3081-418e-8d82-a281b4c346e6 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:06.568232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1261/2498] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:06.849762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:06.851335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:06.863636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf6a7c-1d46-4fe2-a127-12fb61ced4cc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:06.868613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:06.869281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.869574 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.869849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] PATH_INFO: `/v3/projects/cee05688cb0045e3b433d975cd5d3ae8` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.870975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee05688cb0045e3b433d975cd5d3ae8)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:06.872954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:06.921607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee05688cb0045e3b433d975cd5d3ae8', 'request_id': 'req-6ed64356-fb7b-44d5-bd5b-05752cc90b46'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.927678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee05688cb0045e3b433d975cd5d3ae8', 'request_id': 'req-6ed64356-fb7b-44d5-bd5b-05752cc90b46'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.934952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee05688cb0045e3b433d975cd5d3ae8', 'request_id': 'req-6ed64356-fb7b-44d5-bd5b-05752cc90b46'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.946691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] The token cache is being invalidate because project cee05688cb0045e3b433d975cd5d3ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:06.946979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.947615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6ed64356-fb7b-44d5-bd5b-05752cc90b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:06.949186 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1238/2499] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:06 2022] DELETE /identity/v3/projects/cee05688cb0045e3b433d975cd5d3ae8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:06.954366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:06.954655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:06.954955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:06.974550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:06.975736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:07.036527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1262/2500] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:07.045330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.045612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.045884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.066953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:07.068274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:07.077151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1239/2501] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:07.081586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.091079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8d0d9-f753-47c9-b1ea-52fa568bf4c4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.095681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.096818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.097140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.097373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.098007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:07.098507 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.099935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.111173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1263/2502] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:07.172041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.181770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2b72a-8c6b-48fc-8ccb-60e44ccb912a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.189200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.190743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.191241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.191738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.192939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.196487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.223949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1240/2503] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:07 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:07.228116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.237882 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8b0c-78a0-402c-ba06-4355a96d2258 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.287342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:07.294997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.295638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.296097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.296384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.297286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.299416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.319941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1264/2504] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:07 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:07.324116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.334768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58db9e7-0b04-489a-bb79-76afea6ce798 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.339190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.339771 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.340045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.340334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.340960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.342530 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.352263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1241/2505] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:07.355952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.365688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42b70-6fe2-48a0-9ceb-a1e15b1a6fc3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.370234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.370822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.371102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.371375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.372006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.373610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2d9bf-bab9-4141-a0fb-f754784d5832 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.384567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1265/2506] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:07.388533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.399194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82a7b-ec92-4653-a12a-87cd1c02c949 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.403822 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.404491 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.404772 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.405048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] PATH_INFO: `/v3/projects/6d888e93286f4d988af7b4a3323e6851/users/bcd2caa7ddad48c0bab81c09edd642e1/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.419981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d888e93286f4d988af7b4a3323e6851, user_id=bcd2caa7ddad48c0bab81c09edd642e1, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.422703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.435489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1242/2507] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:07 2022] PUT /identity/v3/projects/6d888e93286f4d988af7b4a3323e6851/users/bcd2caa7ddad48c0bab81c09edd642e1/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:07.445876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.446160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.446429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.473045 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] MFA Rules not processed for user `bcd2caa7ddad48c0bab81c09edd642e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:07.474231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:07.538252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1266/2508] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:07.549481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:07.551181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:07.582588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:07.613116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28209443-5920-4d31-b5ff-9001f8373b7c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:07.616874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:07.617476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:07.617755 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:07.618026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:07.626558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:07.627976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c239-e1af-4c12-88b3-978355343042 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:07.637907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1243/2509] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:08.370981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:08.372468 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:08.438291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6583818-fc38-49c8-87b0-8889bdeffeb0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:08.442890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:08.443544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:08.443825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:08.444126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] PATH_INFO: `/v3/users/c1eb40047d834fdab7486d7d4946cbe0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:08.445239 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1eb40047d834fdab7486d7d4946cbe0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:08.447140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:08.492039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1eb40047d834fdab7486d7d4946cbe0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:08.492656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1eb40047d834fdab7486d7d4946cbe0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:08.504311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1eb40047d834fdab7486d7d4946cbe0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:08.504947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1eb40047d834fdab7486d7d4946cbe0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:08.506574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:08.513111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1eb40047d834fdab7486d7d4946cbe0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:08.526940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1267/2510] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:08 2022] DELETE /identity/v3/users/c1eb40047d834fdab7486d7d4946cbe0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:08.531362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:08.531843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:08.531941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:08.550597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:08.551777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:08.607757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1244/2511] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:08.617355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:08.618741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:08.676445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53efc5-1922-4889-8020-2ec294862d77 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:08.680012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:08.680648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:08.680936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:08.681206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:08.690666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:08.692113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:08.701531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1268/2512] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:08.969300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:08.970832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:08.985920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d5bc2-7e69-4591-bf70-5eb4d45b59ea None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:08.990652 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:08.991484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:08.991601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:08.991836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] PATH_INFO: `/v3/projects/545437c65052406cb5084e873e5b34d1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:08.993328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545437c65052406cb5084e873e5b34d1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:08.995258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:09.073429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545437c65052406cb5084e873e5b34d1', 'request_id': 'req-b5d42481-aecd-4a38-aad8-f69f50474ab1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.080381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545437c65052406cb5084e873e5b34d1', 'request_id': 'req-b5d42481-aecd-4a38-aad8-f69f50474ab1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.090269 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545437c65052406cb5084e873e5b34d1', 'request_id': 'req-b5d42481-aecd-4a38-aad8-f69f50474ab1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.104953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] The token cache is being invalidate because project 545437c65052406cb5084e873e5b34d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:09.105554 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.106410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.109056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1245/2513] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:08 2022] DELETE /identity/v3/projects/545437c65052406cb5084e873e5b34d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:09.113130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:09.123031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c62be-414b-4178-85fb-7bf800d44572 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:09.189784 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:09.191070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.191256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.191562 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] PATH_INFO: `/v3/users/ccd5d368d6ad45a6970ab8953739bc3f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.192688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd5d368d6ad45a6970ab8953739bc3f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:09.194596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:09.247205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd5d368d6ad45a6970ab8953739bc3f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.247967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd5d368d6ad45a6970ab8953739bc3f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.262809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd5d368d6ad45a6970ab8953739bc3f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.263630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd5d368d6ad45a6970ab8953739bc3f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.272000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-19560363-3e9c-4aaf-bed0-d6116c1d9e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd5d368d6ad45a6970ab8953739bc3f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.285458 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1269/2514] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:09 2022] DELETE /identity/v3/users/ccd5d368d6ad45a6970ab8953739bc3f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:09.569123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:09.570736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:09.586233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d42481-aecd-4a38-aad8-f69f50474ab1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:09.635769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:09.646487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:09.647125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.647424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.647682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] PATH_INFO: `/v3/projects/90b624ab4e804da091b5fe9e50af1746` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.648833 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b624ab4e804da091b5fe9e50af1746)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:09.650740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:09.696005 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b624ab4e804da091b5fe9e50af1746', 'request_id': 'req-8cb20f74-ba88-4a33-8c04-09f8a650487a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.701343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b624ab4e804da091b5fe9e50af1746', 'request_id': 'req-8cb20f74-ba88-4a33-8c04-09f8a650487a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.708035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b624ab4e804da091b5fe9e50af1746', 'request_id': 'req-8cb20f74-ba88-4a33-8c04-09f8a650487a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.719497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] The token cache is being invalidate because project 90b624ab4e804da091b5fe9e50af1746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:09.719798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.720626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-8cb20f74-ba88-4a33-8c04-09f8a650487a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:09.722154 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1246/2515] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:09 2022] DELETE /identity/v3/projects/90b624ab4e804da091b5fe9e50af1746 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:09.726998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43af832-be56-400d-acda-a35161a4be4e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.727473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43af832-be56-400d-acda-a35161a4be4e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.727561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43af832-be56-400d-acda-a35161a4be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.736450 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:09.750040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e43af832-be56-400d-acda-a35161a4be4e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:09.751225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e43af832-be56-400d-acda-a35161a4be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:09.809149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1270/2516] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:09.817610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.817837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.818114 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.837330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:09.838519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:09.846283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1247/2517] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:09.850399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43af832-be56-400d-acda-a35161a4be4e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:09.859937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43af832-be56-400d-acda-a35161a4be4e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:09.865006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:09.865602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.865881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.866152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.866818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:09.867123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:09.868745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:09.880492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1271/2518] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:09.884986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:09.894091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb1f43-341e-4e8a-8e2e-a9b32d049b3b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:09.898681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:09.899263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:09.899540 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:09.899811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:09.900456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:09.902332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:09.929563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1248/2519] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:09 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:09.933691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:09.944084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab237-5f62-4dbc-88df-6ff2646c178c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.000863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.001463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.001741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.002011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.003263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.005193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.025583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1272/2520] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:09 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:10.029519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.040257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31109c3-b9e3-4be7-a843-df54a3a14656 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.044781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.045363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.045638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.045907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.046533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.048131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.058616 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1249/2521] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:10.062328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.072301 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3677e-2808-4887-a4f9-bf9e8a65a1a1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.076833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.077423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.077706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.077982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.078615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.080227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb603d8-a611-43d0-ad30-6a170c17c420 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.090587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1273/2522] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:10.094306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.105541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37d44-8f97-4b73-9e23-2a23b907c6a0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.110270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.110950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.111229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.111503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] PATH_INFO: `/v3/projects/2842b1aa2bda467b8b6f286262712412/users/b9c065db0e084b9ab83470965fb29f92/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.126263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2842b1aa2bda467b8b6f286262712412, user_id=b9c065db0e084b9ab83470965fb29f92, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.128931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.141443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1250/2523] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:10 2022] PUT /identity/v3/projects/2842b1aa2bda467b8b6f286262712412/users/b9c065db0e084b9ab83470965fb29f92/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:10.152981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.153272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.153547 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.181000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] MFA Rules not processed for user `b9c065db0e084b9ab83470965fb29f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:10.182197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.232831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.234625 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.242389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:10.246574 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1274/2524] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:10.250873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.303191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ea8db-d030-43ad-98ef-e2641834a81d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.307816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.308480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.308756 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.309034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] PATH_INFO: `/v3/users/bcd2caa7ddad48c0bab81c09edd642e1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.310159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd2caa7ddad48c0bab81c09edd642e1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.312085 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.314347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355fd5a-bf97-4a04-be68-ae56bad188cc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.319423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.320021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.320332 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.320602 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.321222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.323153 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.334263 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:10.354375 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1275/2525] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:10 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:10.355384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.359816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd2caa7ddad48c0bab81c09edd642e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:10.360487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd2caa7ddad48c0bab81c09edd642e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:10.368035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd2caa7ddad48c0bab81c09edd642e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:10.375957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd2caa7ddad48c0bab81c09edd642e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:10.376938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-26f9b354-1cc2-4313-92f6-29abd2299238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd2caa7ddad48c0bab81c09edd642e1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:10.395720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1251/2526] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:10 2022] DELETE /identity/v3/users/bcd2caa7ddad48c0bab81c09edd642e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:10.399992 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.400305 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.400587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.419030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ccb2-c0b9-4ae4-b30d-3b38b4e231fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.419488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:10.420837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.482366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.482979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.483260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.483528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.484181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.486125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.491299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1252/2527] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:10.501445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.504250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.520245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1276/2528] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:10 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:10.520245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.522752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.535255 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5df20-9ec8-4ed2-bd4f-0bcfe790c6e0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.539929 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.540690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.540834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.541107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.541741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.543474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.558459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1277/2529] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:10.559595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.570206 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700dc9d-5783-4cf6-aa07-ec94719824cc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.576777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.577442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.577751 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.578027 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] PATH_INFO: `/v3/projects/48f5ebc1bcdf46bba46b694e7406a477/users/e75d19523cc846e8a9c27f255e8fac34/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.578157 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90b36b-5439-470f-8082-9c7db21a9865 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.584199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.585552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.585552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.585552 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.587745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:10.595670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.597814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.600428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5ebc1bcdf46bba46b694e7406a477, user_id=e75d19523cc846e8a9c27f255e8fac34, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.607780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.613659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1253/2530] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:10.622942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1278/2531] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:10 2022] PUT /identity/v3/projects/48f5ebc1bcdf46bba46b694e7406a477/users/e75d19523cc846e8a9c27f255e8fac34/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:10.627180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.637417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ba7fa-182e-4eca-93c2-e29b01991bd8 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.680618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:10.698590 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.699200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.699482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.699757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.700435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.702095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0dc8-8de2-4ec1-b308-fd17e139dec7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.712597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1254/2532] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:10.716952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.728942 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f78b70-caa4-4b48-b8ff-a01bb58f5c47 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.734950 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.735701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.736047 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.736418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] PATH_INFO: `/v3/projects/48f5ebc1bcdf46bba46b694e7406a477/users/e75d19523cc846e8a9c27f255e8fac34/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.738518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5ebc1bcdf46bba46b694e7406a477, user_id=e75d19523cc846e8a9c27f255e8fac34, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.741376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:10.752613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1279/2533] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:10 2022] PUT /identity/v3/projects/48f5ebc1bcdf46bba46b694e7406a477/users/e75d19523cc846e8a9c27f255e8fac34/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:10.764327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.764680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.764910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.794419 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] MFA Rules not processed for user `e75d19523cc846e8a9c27f255e8fac34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:10.795667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.863586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1255/2534] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:10.875587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.878133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.888630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:10.890096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.948326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4072d-107a-4580-b625-d3ade90a2a52 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.951966 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.952606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.952887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.953157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.954912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:10.961122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a5a5b-0999-4ef9-81a9-fa6602b8f9cb None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:10.965765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:10.966391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:10.966673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:10.966950 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] PATH_INFO: `/v3/projects/6d888e93286f4d988af7b4a3323e6851` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:10.968119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d888e93286f4d988af7b4a3323e6851)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:10.970023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.018327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.020084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f761b12-17fb-4916-a05e-fba3547c29eb service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.021135 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d888e93286f4d988af7b4a3323e6851', 'request_id': 'req-fe13db9a-2bb2-459b-b833-e3644e5c9bce'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:11.027703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d888e93286f4d988af7b4a3323e6851', 'request_id': 'req-fe13db9a-2bb2-459b-b833-e3644e5c9bce'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:11.029767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1280/2535] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:11.036080 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d888e93286f4d988af7b4a3323e6851', 'request_id': 'req-fe13db9a-2bb2-459b-b833-e3644e5c9bce'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:11.037341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:11.050364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] The token cache is being invalidate because project 6d888e93286f4d988af7b4a3323e6851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:11.050661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:11.051324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fe13db9a-2bb2-459b-b833-e3644e5c9bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:11.052903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1256/2536] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:10 2022] DELETE /identity/v3/projects/6d888e93286f4d988af7b4a3323e6851 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:11.057983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.058270 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.058539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.078003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:11.079229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:11.139223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1281/2537] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:11.147163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.147456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.147762 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.167823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:11.169067 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:11.177437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1257/2538] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:11.182393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.192913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b5430-08cd-4a18-b793-c0c582f8eb4a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.197550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.198190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.198471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.198742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.199419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:11.199725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.201413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.213825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1282/2539] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:11.218160 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.228239 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba4677-3db2-4fe6-8bb3-a46e6a8d83bc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.236212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.237318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.237722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.238077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.238713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.240787 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.276103 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1258/2540] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:11 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:11.277231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.288990 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34122d20-b4c4-4ff8-9289-bb9104102f88 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.300838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:11.356992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.357568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.357849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.358160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.358797 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.360924 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.381654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1283/2541] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:11 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:11.386071 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.396811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce3178-10d8-4ad9-9482-78f6f94378ab admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.401348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.401934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.402234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.402503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.403132 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.404768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.415111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1259/2542] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:11.419404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.430813 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaace8f-9f01-4191-8c00-1c34e17118f9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.435442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.436039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.436343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.436615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.437242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.438824 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5084d-7d09-421e-a953-05cf1ddd4406 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.449178 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1284/2543] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:11.453249 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.463611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33174b-d2dc-4342-a9dd-3614004b9fc1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.468161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.468816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.469106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.469391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] PATH_INFO: `/v3/projects/0a0f29deb49845c8b0d6b1afe6852a46/users/1329298ce45d4329bdcb9450e12bca1d/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.484232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f29deb49845c8b0d6b1afe6852a46, user_id=1329298ce45d4329bdcb9450e12bca1d, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.486929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.499593 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1260/2544] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:11 2022] PUT /identity/v3/projects/0a0f29deb49845c8b0d6b1afe6852a46/users/1329298ce45d4329bdcb9450e12bca1d/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:11.511395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.511791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.512030 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.540510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] MFA Rules not processed for user `1329298ce45d4329bdcb9450e12bca1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:11.541741 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:11.606576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1285/2545] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:11.617045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:11.618763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:11.678976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc08f26-e6b4-465a-9739-b0063e196a51 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:11.682580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:11.683181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:11.683457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:11.683724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:11.692604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:11.694030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:11.702679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1261/2546] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:12.398998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:12.408483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4865149-f17c-400a-a2c3-225623242f98 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:12.412630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:12.413253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:12.413536 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:12.413809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:12.415483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:12.477174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:12.478581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8f2d2-d6b5-4942-8e18-4e5f649c04f7 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:12.487766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1286/2547] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:16.313928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:16.315315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:16.384335 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ff3ed-e43e-42ff-a00a-87e8466a8e92 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:16.388782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:16.389397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:16.389672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:16.389957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] PATH_INFO: `/v3/users/b9c065db0e084b9ab83470965fb29f92` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:16.391042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c065db0e084b9ab83470965fb29f92)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:16.392974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:16.437150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:16.449855 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c065db0e084b9ab83470965fb29f92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:16.450999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c065db0e084b9ab83470965fb29f92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:16.462415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c065db0e084b9ab83470965fb29f92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:16.469624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c065db0e084b9ab83470965fb29f92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:16.470600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c065db0e084b9ab83470965fb29f92'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:16.497424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1262/2548] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:16 2022] DELETE /identity/v3/users/b9c065db0e084b9ab83470965fb29f92 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:16.502132 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:16.502611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:16.502708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:16.524171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:16.525369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:16.537957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:16.599664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1287/2549] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:16.616281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:16.616281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:16.687450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1ffc-ab60-417a-b5b8-09d4db995d58 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:16.696955 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:16.697577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:16.698056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:16.699109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:16.711411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:16.713128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:16.746203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1263/2550] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:17.034184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:17.035618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:17.048280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80d95-ac6f-474c-9fe7-88ced1c6aaf3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:17.053055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:17.053696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.053982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.054252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] PATH_INFO: `/v3/projects/2842b1aa2bda467b8b6f286262712412` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.055383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2842b1aa2bda467b8b6f286262712412)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:17.057351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:17.113743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2842b1aa2bda467b8b6f286262712412', 'request_id': 'req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.119514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2842b1aa2bda467b8b6f286262712412', 'request_id': 'req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.125972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2842b1aa2bda467b8b6f286262712412', 'request_id': 'req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.140221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] The token cache is being invalidate because project 2842b1aa2bda467b8b6f286262712412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:17.140511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.141197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.142733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1288/2551] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:17 2022] DELETE /identity/v3/projects/2842b1aa2bda467b8b6f286262712412 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:17.147503 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:17.157322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a60a-9476-4f06-be45-f5686612d181 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:17.214226 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:17.214844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.215040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.215343 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] PATH_INFO: `/v3/users/e75d19523cc846e8a9c27f255e8fac34` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.216475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75d19523cc846e8a9c27f255e8fac34)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:17.218407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:17.270208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75d19523cc846e8a9c27f255e8fac34'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.270860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75d19523cc846e8a9c27f255e8fac34'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.279920 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75d19523cc846e8a9c27f255e8fac34'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.282171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:17.289223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75d19523cc846e8a9c27f255e8fac34'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.290431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-36d7e988-efc3-4c17-ac0c-2d815765098c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75d19523cc846e8a9c27f255e8fac34'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.308828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1264/2552] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:17 2022] DELETE /identity/v3/users/e75d19523cc846e8a9c27f255e8fac34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:17.587585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:17.589073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:17.602668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e40fe-80bf-43c6-bb9b-dfad5ba4654c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:17.675861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:17.676540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.676818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.677115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] PATH_INFO: `/v3/projects/48f5ebc1bcdf46bba46b694e7406a477` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.678228 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f5ebc1bcdf46bba46b694e7406a477)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:17.684311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:17.738390 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:17.742071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f5ebc1bcdf46bba46b694e7406a477', 'request_id': 'req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.749777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f5ebc1bcdf46bba46b694e7406a477', 'request_id': 'req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.756261 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f5ebc1bcdf46bba46b694e7406a477', 'request_id': 'req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.770020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] The token cache is being invalidate because project 48f5ebc1bcdf46bba46b694e7406a477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:17.770333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.771119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7ef7211-6bad-4ca1-ac0f-0576938ee5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:17.772499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1289/2553] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:17 2022] DELETE /identity/v3/projects/48f5ebc1bcdf46bba46b694e7406a477 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:17.777320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.777838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.777838 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.797800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:17.798918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:17.873751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1265/2554] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:17.876329 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.876614 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.876885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.905695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:17.907040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:17.919865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1290/2555] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:17.923856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:17.933551 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9b9e-c4d7-4af2-9b0a-6f99a6782aca None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:17.938182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:17.938843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.939187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.939544 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.940395 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:17.940681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:17.942354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:17.957410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1266/2556] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:17.961586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:17.970930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc46d-3c6a-4065-adfd-0e88d05336ac None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:17.976260 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:17.976854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:17.977129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:17.977397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:17.978022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:17.979881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.009490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1291/2557] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:17 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:18.014059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.024641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b8e0-f418-459e-9281-3a36f181470b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.088816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.089440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.089719 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.089991 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.090633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.092570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.115810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1267/2558] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:18 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:18.119679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.130082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc15bf-0967-43de-b489-360755c0905d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.135666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.136416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.136818 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.137160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.137872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.139530 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.151499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1292/2559] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:18.155677 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.166892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960749b-8365-49ec-982e-91a901a7b2f1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.171958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.172606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.172887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.173163 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.173805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.175479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e0861-0dd2-482f-a712-c70fe0571736 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.190185 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1268/2560] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:18.191173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.202644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99372b-34ac-44ba-a1bf-ab97c86d4b0d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.208689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.209361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.209770 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.210097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] PATH_INFO: `/v3/projects/b0c87c83f1a6450f8f717576e5cb0a23/users/63f97862cf9c44979dab22e9b5947eaf/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.226282 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c87c83f1a6450f8f717576e5cb0a23, user_id=63f97862cf9c44979dab22e9b5947eaf, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.229000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.248411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1293/2561] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:18 2022] PUT /identity/v3/projects/b0c87c83f1a6450f8f717576e5cb0a23/users/63f97862cf9c44979dab22e9b5947eaf/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:18.261549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.261843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.262119 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.293711 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] MFA Rules not processed for user `63f97862cf9c44979dab22e9b5947eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:18.295017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:18.326461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:18.364018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1269/2562] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:18.370526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.443214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d683a-2726-422d-9c58-b0755bfade29 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.448275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.448880 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.449162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.449451 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.450136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.452019 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.482011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1294/2563] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:18 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:18.485207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.497314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7d00-d6e1-4283-a99e-a36c45654e18 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.565115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.566130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.566413 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.566687 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.567306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.569307 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.591684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1270/2564] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:18 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:18.595595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.606494 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342c890-05f2-4e2f-af58-6967301b475d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.611403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.612007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.612324 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.612596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.613274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.614932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.626768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1295/2565] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:18.632175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.642826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408269a-2627-492f-a364-fbe8ea032734 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.648091 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.648748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.649029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.649304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] PATH_INFO: `/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca/users/5efeafc8114b41bb99ea92ad5f2878e2/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.665869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb704b3a5d9d4825bc0a1b395a3db5ca, user_id=5efeafc8114b41bb99ea92ad5f2878e2, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.668571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.685013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1271/2566] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:18 2022] PUT /identity/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca/users/5efeafc8114b41bb99ea92ad5f2878e2/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:18.688958 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.699974 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68cee2-5376-42cf-a561-f528296ac758 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.739908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:18.758659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.759268 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.759549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.759821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.760483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.762074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074061a-45b5-4bb0-add4-0f9813d28f7b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.771846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1296/2567] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:18.776031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.786612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d9343-78b3-4eef-adbc-a3b856680ed0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.791231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.791873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.792188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.792465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] PATH_INFO: `/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca/users/5efeafc8114b41bb99ea92ad5f2878e2/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.794391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb704b3a5d9d4825bc0a1b395a3db5ca, user_id=5efeafc8114b41bb99ea92ad5f2878e2, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:18.797017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:18.807663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1272/2568] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:18 2022] PUT /identity/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca/users/5efeafc8114b41bb99ea92ad5f2878e2/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:18.818452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.818671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.818945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.845933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] MFA Rules not processed for user `5efeafc8114b41bb99ea92ad5f2878e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:18.847148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:18.914463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1297/2569] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:18.926907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:18.928675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:18.984781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2578f-4d6a-429c-bd08-98064b43e9a1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:18.989170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:18.989781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:18.990058 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:18.990329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:18.999208 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:19.000680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526d7ca-9615-455f-8ea8-c79f51389632 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:19.010981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1273/2570] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:19.149256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:19.211077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d014e0-1413-46b7-9ce1-a4f19951e41b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:19.215599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:19.216256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:19.216539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:19.216812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] PATH_INFO: `/v3/users/63f97862cf9c44979dab22e9b5947eaf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:19.217934 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f97862cf9c44979dab22e9b5947eaf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:19.219850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:19.265526 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f97862cf9c44979dab22e9b5947eaf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.266171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f97862cf9c44979dab22e9b5947eaf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.283591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f97862cf9c44979dab22e9b5947eaf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.285417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f97862cf9c44979dab22e9b5947eaf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.290384 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:19.293810 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f97862cf9c44979dab22e9b5947eaf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.308182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1298/2571] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:19 2022] DELETE /identity/v3/users/63f97862cf9c44979dab22e9b5947eaf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:19.311794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:19.312107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:19.312382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:19.333746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:19.335138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:19.367508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:19.420882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1274/2572] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:19.435114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:19.437152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:19.505696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863125-6f24-49ce-b656-5b18cb1fbc2b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:19.510262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:19.510933 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:19.511246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:19.511641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:19.521697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:19.523388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:19.533821 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1299/2573] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:19.830010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:19.832035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:19.845698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545067a-c4e3-4fbf-9f1c-b53d7daae7f2 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:19.850299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:19.850979 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:19.851261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:19.851532 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] PATH_INFO: `/v3/projects/b0c87c83f1a6450f8f717576e5cb0a23` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:19.853347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c87c83f1a6450f8f717576e5cb0a23)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:19.855311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:19.902420 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c87c83f1a6450f8f717576e5cb0a23', 'request_id': 'req-2ff7d54e-b174-40b8-9c87-409587ee621d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.907947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c87c83f1a6450f8f717576e5cb0a23', 'request_id': 'req-2ff7d54e-b174-40b8-9c87-409587ee621d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.915348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c87c83f1a6450f8f717576e5cb0a23', 'request_id': 'req-2ff7d54e-b174-40b8-9c87-409587ee621d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.926130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] The token cache is being invalidate because project b0c87c83f1a6450f8f717576e5cb0a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:19.926414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.927033 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:19.928527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1275/2574] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:19 2022] DELETE /identity/v3/projects/b0c87c83f1a6450f8f717576e5cb0a23 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:19.932498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:19.942571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ba06-04ed-43d2-adc3-091eba6cffc9 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.000188 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.000820 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.001102 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.001374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] PATH_INFO: `/v3/users/5efeafc8114b41bb99ea92ad5f2878e2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.002478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efeafc8114b41bb99ea92ad5f2878e2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.004962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.049437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efeafc8114b41bb99ea92ad5f2878e2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.050081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efeafc8114b41bb99ea92ad5f2878e2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.061489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efeafc8114b41bb99ea92ad5f2878e2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.062155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efeafc8114b41bb99ea92ad5f2878e2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.069954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0ca00694-c8e1-4dbf-951f-c087e72d7b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efeafc8114b41bb99ea92ad5f2878e2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.082661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1300/2575] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:19 2022] DELETE /identity/v3/users/5efeafc8114b41bb99ea92ad5f2878e2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:20.347577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.349029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:20.364282 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d54e-b174-40b8-9c87-409587ee621d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.419429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.420046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.420350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.420619 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] PATH_INFO: `/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.421708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb704b3a5d9d4825bc0a1b395a3db5ca)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.423609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.469146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb704b3a5d9d4825bc0a1b395a3db5ca', 'request_id': 'req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.470309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:20.478046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb704b3a5d9d4825bc0a1b395a3db5ca', 'request_id': 'req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.488337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb704b3a5d9d4825bc0a1b395a3db5ca', 'request_id': 'req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.499776 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] The token cache is being invalidate because project bb704b3a5d9d4825bc0a1b395a3db5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:20.500084 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.500738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c4ce4590-d3a8-4d97-a2f6-f7e9be5efc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:20.502341 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1276/2576] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:20 2022] DELETE /identity/v3/projects/bb704b3a5d9d4825bc0a1b395a3db5ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:20.508241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.508527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.508837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.518550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:20.532640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:20.534598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:20.601833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1301/2577] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:20.610216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563040-d00a-4784-894c-1419286915ce None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.610499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563040-d00a-4784-894c-1419286915ce None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.610774 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83563040-d00a-4784-894c-1419286915ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.630769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-83563040-d00a-4784-894c-1419286915ce None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:20.631982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-83563040-d00a-4784-894c-1419286915ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:20.641101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1277/2578] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:20.649956 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.662317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814b67f-4172-4bb0-b4c1-c4ab95ca86c2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.667180 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.667779 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.668182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.668486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.669364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:20.669679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.671480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.685681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1302/2579] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:20.690457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83563040-d00a-4784-894c-1419286915ce None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.700849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83563040-d00a-4784-894c-1419286915ce None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.705636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.706237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.706522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.706789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.707411 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.709329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.751057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1278/2580] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:20 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:20.756624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.767054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff05453-32f3-47e6-9223-7185232ec995 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.828537 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.829163 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.829443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.829822 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.830441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.832391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.854889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1303/2581] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:20 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:20.859257 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.871902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e40d-3466-4e3a-95f4-3b985bf809cc admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.876725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.877389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.877739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.878115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.878871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.880535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.894457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1279/2582] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:20.895874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.906309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2268a-03e1-4d7e-8f99-906d2744b8ff admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.912004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.912865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.913874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.914152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.914848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.916846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eee80-af03-47fe-ad1a-2fdaeae481ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.933211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1304/2583] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:20.935139 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:20.948171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c622b-1f77-4c9f-bb6a-fa7a04ad1fc3 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:20.953054 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:20.953951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:20.954351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:20.954629 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] PATH_INFO: `/v3/projects/507c3cd0d62a4d8cb1e2b0a652ac29cb/users/bf903e48598f44429e357c50f2e94d2a/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:20.972830 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] RBAC: Authorizing `identity:create_grant(project_id=507c3cd0d62a4d8cb1e2b0a652ac29cb, user_id=bf903e48598f44429e357c50f2e94d2a, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:20.975808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:20.991621 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1280/2584] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:20 2022] PUT /identity/v3/projects/507c3cd0d62a4d8cb1e2b0a652ac29cb/users/bf903e48598f44429e357c50f2e94d2a/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:21.001815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:21.002104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:21.002383 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:21.036126 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] MFA Rules not processed for user `bf903e48598f44429e357c50f2e94d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:21.037343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:21.097377 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:21.101608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1305/2585] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:21.112784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:21.114522 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:21.171442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d41f1-6680-4f65-ae29-90552c8a966b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:21.175278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:21.175927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:21.176237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:21.176506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:21.184521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:21.185931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f8b6f-a628-4408-9240-67596e9497c2 service glance] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:21.194508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1281/2586] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:21.623276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:21.624671 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:21.695238 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8550-74f7-4fed-b779-593995bb0403 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:21.699759 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:21.700407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:21.700685 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:21.700981 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] PATH_INFO: `/v3/users/1329298ce45d4329bdcb9450e12bca1d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:21.702125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1329298ce45d4329bdcb9450e12bca1d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:21.704049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:21.751055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1329298ce45d4329bdcb9450e12bca1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:21.751841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1329298ce45d4329bdcb9450e12bca1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:21.765287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1329298ce45d4329bdcb9450e12bca1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:21.765936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1329298ce45d4329bdcb9450e12bca1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:21.774073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1329298ce45d4329bdcb9450e12bca1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:21.787197 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1306/2587] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:21 2022] DELETE /identity/v3/users/1329298ce45d4329bdcb9450e12bca1d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:21.791685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:21.791970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:21.792272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:21.812741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:21.813919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:22.004268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1282/2588] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:22.014104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:22.015486 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:22.079123 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f845b2-6f7c-42f9-8eff-dcc0b9d8d446 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:22.082747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:22.083350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:22.083628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:22.083898 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:22.092834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:22.094254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:22.104525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1307/2589] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:22.400330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:22.401814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:22.416550 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88c31b-37a9-43a7-8812-615919f8636f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:22.421365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:22.423073 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:22.423802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:22.425252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] PATH_INFO: `/v3/projects/0a0f29deb49845c8b0d6b1afe6852a46` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:22.426854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f29deb49845c8b0d6b1afe6852a46)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:22.429213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:22.441362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:22.478499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f29deb49845c8b0d6b1afe6852a46', 'request_id': 'req-e85d5113-d152-4e0d-a6a2-05ab970b88fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:22.486720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f29deb49845c8b0d6b1afe6852a46', 'request_id': 'req-e85d5113-d152-4e0d-a6a2-05ab970b88fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:22.495203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f29deb49845c8b0d6b1afe6852a46', 'request_id': 'req-e85d5113-d152-4e0d-a6a2-05ab970b88fa'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:22.506945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] The token cache is being invalidate because project 0a0f29deb49845c8b0d6b1afe6852a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:22.507236 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:22.508165 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e85d5113-d152-4e0d-a6a2-05ab970b88fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:22.509633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1283/2590] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:22 2022] DELETE /identity/v3/projects/0a0f29deb49845c8b0d6b1afe6852a46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:26.405469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:26.406949 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:26.420799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5ce20-508a-4cd6-94d8-f457c6cea3e7 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:26.438806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:26.480785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:26.481418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:26.481692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:26.481961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] PATH_INFO: `/v3/users/ba8734438e0f4964b32b1f49097afab2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:26.483053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8734438e0f4964b32b1f49097afab2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:26.485031 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:26.532775 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8734438e0f4964b32b1f49097afab2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:26.533420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8734438e0f4964b32b1f49097afab2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:26.545428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8734438e0f4964b32b1f49097afab2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:26.546070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8734438e0f4964b32b1f49097afab2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:26.552811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8734438e0f4964b32b1f49097afab2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:26.565792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1308/2591] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:26 2022] DELETE /identity/v3/users/ba8734438e0f4964b32b1f49097afab2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:26.570854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:26.571448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:26.571448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:26.591141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:26.592380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:26.648404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1284/2592] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:26.657913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:26.659467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:26.717327 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc3550-c23f-4bcc-b463-8e6170dfd716 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:26.721857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:26.722465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:26.722739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:26.723007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:26.732193 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:26.733611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:26.744768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1309/2593] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:27.019995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:27.021541 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:27.037180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bed88-a471-4f63-becb-7b768b80287a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:27.043568 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:27.044369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.045050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.045205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] PATH_INFO: `/v3/projects/b8b24d9cb13e473c92a0b136edb54e0d` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.046311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b24d9cb13e473c92a0b136edb54e0d)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:27.048264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:27.094523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b24d9cb13e473c92a0b136edb54e0d', 'request_id': 'req-af40b577-5790-4976-81e2-c05378c2264d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.099976 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b24d9cb13e473c92a0b136edb54e0d', 'request_id': 'req-af40b577-5790-4976-81e2-c05378c2264d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.107798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b24d9cb13e473c92a0b136edb54e0d', 'request_id': 'req-af40b577-5790-4976-81e2-c05378c2264d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.122951 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] The token cache is being invalidate because project b8b24d9cb13e473c92a0b136edb54e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:27.123377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.123897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.125436 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1285/2594] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:27 2022] DELETE /identity/v3/projects/b8b24d9cb13e473c92a0b136edb54e0d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:27.129570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:27.140460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7279-47e7-44ad-8701-ec02cf1783b5 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:27.181121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:27.197236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:27.197861 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.198138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.198408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] PATH_INFO: `/v3/users/8281900ef5b34109ae3ede97a30a226b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.199500 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8281900ef5b34109ae3ede97a30a226b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:27.201432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:27.246281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8281900ef5b34109ae3ede97a30a226b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.246926 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8281900ef5b34109ae3ede97a30a226b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.258766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8281900ef5b34109ae3ede97a30a226b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.259391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8281900ef5b34109ae3ede97a30a226b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.266463 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a8a29713-89e0-4f50-b3d9-39bdc347aaf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8281900ef5b34109ae3ede97a30a226b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.279404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1310/2595] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:27 2022] DELETE /identity/v3/users/8281900ef5b34109ae3ede97a30a226b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:27.555528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:27.557299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:27.570928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40b577-5790-4976-81e2-c05378c2264d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:27.609125 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:27.655501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:27.656267 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.656547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.656816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] PATH_INFO: `/v3/projects/f62f813b7d604a18905bc6613f701bca` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.657932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62f813b7d604a18905bc6613f701bca)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:27.659813 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:27.706614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62f813b7d604a18905bc6613f701bca', 'request_id': 'req-c0fb8732-7105-427d-a81a-65c5b0d9789e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.712151 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62f813b7d604a18905bc6613f701bca', 'request_id': 'req-c0fb8732-7105-427d-a81a-65c5b0d9789e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.724875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62f813b7d604a18905bc6613f701bca', 'request_id': 'req-c0fb8732-7105-427d-a81a-65c5b0d9789e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.748188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] The token cache is being invalidate because project f62f813b7d604a18905bc6613f701bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:27.748584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.751292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-c0fb8732-7105-427d-a81a-65c5b0d9789e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:27.752946 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1286/2596] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:27 2022] DELETE /identity/v3/projects/f62f813b7d604a18905bc6613f701bca => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:27.758763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.759241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.759459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.778921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:27.780174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:27.839812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1311/2597] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:27.847753 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.848146 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.848487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.869325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:27.870609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:27.878583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1287/2598] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:27.883760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:27.893269 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f83f-42e0-4967-b688-a927ebd8f098 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:27.898187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:27.898785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.899063 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.899863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.900551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:27.900954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:27.902997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:27.934684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1312/2599] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:47:27.939166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:27.949782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a4e31-446e-43cc-9f45-3efe37cbe0ae None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:27.954918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:27.955518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:27.955789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:27.956078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:27.956712 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:27.958654 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:27.985783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1288/2600] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:27 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:27.990584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.000815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a0fb5-1626-4c03-bcdc-13ecf77c81da admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.049567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:28.061391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.062077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.062417 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.063347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.064053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.066252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.092729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1313/2601] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:27 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:28.097735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.110598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb354fd-ca9e-4fff-a8bc-41f6398e5dec admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.115897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.116535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.116809 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.117075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.117702 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.119376 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.132614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1289/2602] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:28.134124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.143869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b829a-6fdf-4014-94b2-12ca76452d7b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.148567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.149157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.149433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.149703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.150334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.151915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042395-1185-431e-917d-f11e52082d0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.163122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1314/2603] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:28.167423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.177941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae90b3-7eac-4083-8a4f-6a21475c6810 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.182646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.183288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.183565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.183832 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] PATH_INFO: `/v3/projects/5db112db1ab74050906e2594ef2c04c3/users/655ec907dc9440ffaf4666c24a91c2be/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.198764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db112db1ab74050906e2594ef2c04c3, user_id=655ec907dc9440ffaf4666c24a91c2be, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.201418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.215516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1290/2604] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:28 2022] PUT /identity/v3/projects/5db112db1ab74050906e2594ef2c04c3/users/655ec907dc9440ffaf4666c24a91c2be/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:28.225606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.225991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.226354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.256952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] MFA Rules not processed for user `655ec907dc9440ffaf4666c24a91c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:28.258466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:28.332273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1315/2605] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:28.337296 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.390215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:28.404514 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320b402-eaa8-451b-a2fb-f1fbb4c56d2b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.410210 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.410851 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.411205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.411423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.412266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.414614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.447660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1291/2606] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:28 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:28.449119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.460148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88128a4-62f6-47f2-8d48-026c54e27e56 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.516408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.517020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.517310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.517582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.518209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.520156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.546680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1316/2607] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:28 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:28.550805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.563910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4fbf6-61c4-4741-a840-6ff4971c1702 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.570926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.572031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.572606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.572841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.573690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.575716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.598398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1292/2608] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:28.602362 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.614053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63710c28-756e-441b-8ae9-9495ad90faba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.621127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.622343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.622766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.623216 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] PATH_INFO: `/v3/projects/fc00a81a31124a53943227fd20438d1a/users/085bd3c1e48b4634b0025980bf6dfd27/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.650695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc00a81a31124a53943227fd20438d1a, user_id=085bd3c1e48b4634b0025980bf6dfd27, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.659662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.705700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1317/2609] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:28 2022] PUT /identity/v3/projects/fc00a81a31124a53943227fd20438d1a/users/085bd3c1e48b4634b0025980bf6dfd27/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:28.710561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.722640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c355c8-4225-4586-a221-59a366c61d90 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.809703 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.810322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.810597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.810866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.811513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.813181 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23b5e0-fa66-493a-8fae-b595f538fe09 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.825664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1293/2610] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:28.830232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:28.845514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13410e-d231-461d-b557-250b82bb00fa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:28.852607 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:28.853408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.853766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.854482 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] PATH_INFO: `/v3/projects/fc00a81a31124a53943227fd20438d1a/users/085bd3c1e48b4634b0025980bf6dfd27/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.856354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc00a81a31124a53943227fd20438d1a, user_id=085bd3c1e48b4634b0025980bf6dfd27, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:28.859543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:28.886771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1318/2611] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:28 2022] PUT /identity/v3/projects/fc00a81a31124a53943227fd20438d1a/users/085bd3c1e48b4634b0025980bf6dfd27/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:28.905954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:28.906150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:28.906403 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:28.933622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] MFA Rules not processed for user `085bd3c1e48b4634b0025980bf6dfd27`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:28.934806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:29.008398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1294/2612] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:29.019208 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:29.021654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:29.035841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:29.101470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4ae0a-7a56-46e3-85f6-5bc8a28c397f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:29.105191 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:29.105804 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:29.106082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:29.106850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:29.175581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:29.177702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:29.187679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1319/2613] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:31.798136 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:31.799548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:31.813994 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8343f9-0382-4fff-9cc9-ff42a6b085af None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:31.820435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:31.821039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:31.821318 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:31.821586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:31.831432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:31.832900 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:31.842667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1295/2614] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:33.033403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:33.034825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:33.090701 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665138-404c-499f-9c4a-118e85905324 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:33.094209 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:33.094803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:33.095077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:33.095345 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:33.097051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:33.159252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:33.160718 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:33.170875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1320/2615] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:36.752010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:36.753722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:36.769799 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadf9a2-8469-490b-9572-ecd0c5eb3aa9 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:36.775589 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:36.776591 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:36.777075 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:36.777542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] PATH_INFO: `/v3/users/bf903e48598f44429e357c50f2e94d2a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:36.783248 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf903e48598f44429e357c50f2e94d2a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:36.786040 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:36.823148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:36.854438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf903e48598f44429e357c50f2e94d2a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:36.855308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf903e48598f44429e357c50f2e94d2a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:36.863932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf903e48598f44429e357c50f2e94d2a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:36.871633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf903e48598f44429e357c50f2e94d2a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:36.872293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9014d50a-f159-4aa5-b976-83e277705183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf903e48598f44429e357c50f2e94d2a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:36.904529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1296/2616] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:36 2022] DELETE /identity/v3/users/bf903e48598f44429e357c50f2e94d2a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:36.908792 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:36.909558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:36.910271 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:36.912288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:36.912708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:36.924210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543f5b4-9511-4dcb-9d45-6788d31cde8f service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:36.937173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:36.940473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:36.941784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:36.997315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:36.998725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:36.999205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:36.999597 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] PATH_INFO: `/v3/users/c19359f992c54313b7b1dfee4553f7eb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.000889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19359f992c54313b7b1dfee4553f7eb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.003128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.022041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1297/2617] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:37.032463 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.034559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.060326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19359f992c54313b7b1dfee4553f7eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.061172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19359f992c54313b7b1dfee4553f7eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.078726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19359f992c54313b7b1dfee4553f7eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.079525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19359f992c54313b7b1dfee4553f7eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.088139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19359f992c54313b7b1dfee4553f7eb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.102938 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326d39c-8024-4157-ac7f-5b6f1a58065e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.107714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.108479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.108849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.109278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.109498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1321/2618] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:36 2022] DELETE /identity/v3/users/c19359f992c54313b7b1dfee4553f7eb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:37.111190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.126875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.128563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.139302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1298/2619] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:37.491477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.493256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.572637 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1cb1d-5a67-4f32-933c-3c82ebaa1262 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.578322 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.579023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.579296 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.579675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] PATH_INFO: `/v3/projects/e84a3a18907a4e5e9b5c131dda4c3c63` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.580892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84a3a18907a4e5e9b5c131dda4c3c63)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.583264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.592982 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.594841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.618012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661d9f-f948-44f3-9713-6e064df50e4a service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.623847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.624513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.624837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.625053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] PATH_INFO: `/v3/projects/507c3cd0d62a4d8cb1e2b0a652ac29cb` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.626301 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=507c3cd0d62a4d8cb1e2b0a652ac29cb)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.628443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.630538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:37.641800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84a3a18907a4e5e9b5c131dda4c3c63', 'request_id': 'req-edc1596f-1150-4ebc-a259-9735cbd13ae5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.647890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84a3a18907a4e5e9b5c131dda4c3c63', 'request_id': 'req-edc1596f-1150-4ebc-a259-9735cbd13ae5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.654259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84a3a18907a4e5e9b5c131dda4c3c63', 'request_id': 'req-edc1596f-1150-4ebc-a259-9735cbd13ae5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.668825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] The token cache is being invalidate because project e84a3a18907a4e5e9b5c131dda4c3c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:37.669039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.669771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-edc1596f-1150-4ebc-a259-9735cbd13ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.671556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1322/2620] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:37 2022] DELETE /identity/v3/projects/e84a3a18907a4e5e9b5c131dda4c3c63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:37.675351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:37.676328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38a07-9fb6-4b2b-af46-4c4e54714059 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.676846 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38a07-9fb6-4b2b-af46-4c4e54714059 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.677184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38a07-9fb6-4b2b-af46-4c4e54714059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.680313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507c3cd0d62a4d8cb1e2b0a652ac29cb', 'request_id': 'req-7471a26c-54da-4c90-937b-d356560c2a8e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.686932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507c3cd0d62a4d8cb1e2b0a652ac29cb', 'request_id': 'req-7471a26c-54da-4c90-937b-d356560c2a8e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.695313 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507c3cd0d62a4d8cb1e2b0a652ac29cb', 'request_id': 'req-7471a26c-54da-4c90-937b-d356560c2a8e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.698594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-82f38a07-9fb6-4b2b-af46-4c4e54714059 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:37.699812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-82f38a07-9fb6-4b2b-af46-4c4e54714059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.706560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] The token cache is being invalidate because project 507c3cd0d62a4d8cb1e2b0a652ac29cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:37.706847 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.707476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7471a26c-54da-4c90-937b-d356560c2a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:37.708966 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1299/2621] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:37 2022] DELETE /identity/v3/projects/507c3cd0d62a4d8cb1e2b0a652ac29cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:37.713606 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac77ce-a72c-488b-b8a3-4df8f162d94a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.713888 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac77ce-a72c-488b-b8a3-4df8f162d94a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.714158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac77ce-a72c-488b-b8a3-4df8f162d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.737571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a2ac77ce-a72c-488b-b8a3-4df8f162d94a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:37.738947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a2ac77ce-a72c-488b-b8a3-4df8f162d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.768359 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1323/2622] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:37.776168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.776466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.776746 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.797472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:37.798721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.801006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1300/2623] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:37.807484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1324/2624] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:37.809138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.809424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.809694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.811467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.820756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71147cc-dcb5-414e-85c7-b68ff227c8f2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.825610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.826200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.826477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.826743 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.827380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:37.827681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.829305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.830110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:37.831331 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:37.839214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1301/2625] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:37.844555 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1325/2626] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:47:37.844694 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.845755 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.852820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ef64-fb1d-4328-8f4a-87a64d0fe1ae None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.855829 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda263-d37f-4855-afc6-e97b2bf96d19 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.857636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.858215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.858490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.858821 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.859457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:37.859758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.860475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.861054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.861335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.861441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.861608 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.862220 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.864098 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.873635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1302/2627] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:37.877782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.887765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b49a5c-794a-441c-8c5d-2cbbae92b74a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.895506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1326/2628] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:37.895667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.895667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.895667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.895667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.896051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.896222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:37.896462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.922964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1303/2629] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:37.926929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:37.958646 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3403-7444-42f7-b7e1-3a20c031cdc9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.987466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ed24-89b0-49ac-a0b6-45f741ec342e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:37.988152 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:37.993688 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:37.994322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:37.994596 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:37.994889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:37.995492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:37.997556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.018828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1304/2630] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.019738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.020444 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.020730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.021004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.021675 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.023059 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.023780 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.032655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00482759-55a9-4aef-9e27-314a2efddf80 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.037359 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.038483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.038761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.039046 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.039718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.041266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.046343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1327/2631] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:37 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.050490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.058221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1305/2632] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:38.059241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.061815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe01fb-6310-4bf9-8ba0-f6d9c6dfdbc6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.067204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.067800 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.068111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.068393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.068866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb90413-29b1-4122-ad5c-67f337968acb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.069057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.070638 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.073434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.074009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.074286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.074557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.075180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.076766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.078840 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:38.085066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1328/2633] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:38.086356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.092340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1306/2634] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:38.093196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.096307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf000-5e04-40c3-851f-e3c4f4ebfccd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.101549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.102142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.102418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.102689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.103311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.103449 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f6522-39b5-462b-a7f8-0abcc2ade55e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.104937 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.108204 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.108831 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.109109 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.109378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] PATH_INFO: `/v3/projects/0ac0022a059f48f487b7b1b27bc1eb02/users/942e9e108f144003b63c6be450a4a2c1/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.115294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1329/2635] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:38.119639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.125342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac0022a059f48f487b7b1b27bc1eb02, user_id=942e9e108f144003b63c6be450a4a2c1, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.128231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6a7a2-65fd-41a8-a8c2-bee502ad7cd8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.130452 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e4568-b5d9-411e-9ad9-5c2513902573 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.137836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.139023 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.139652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.140249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] PATH_INFO: `/v3/projects/d74a7012ff064aef868addd85df8993e/users/1113f4c427bf436db0e8b1af2cf9123c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.148130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1307/2636] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:38 2022] PUT /identity/v3/projects/0ac0022a059f48f487b7b1b27bc1eb02/users/942e9e108f144003b63c6be450a4a2c1/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:38.159801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74a7012ff064aef868addd85df8993e, user_id=1113f4c427bf436db0e8b1af2cf9123c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.163545 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59245d82-2457-4694-a87a-0eba10fd4f4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.184236 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1330/2637] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:38 2022] PUT /identity/v3/projects/d74a7012ff064aef868addd85df8993e/users/1113f4c427bf436db0e8b1af2cf9123c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:38.195907 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.196429 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.196796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.213945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e736-97cc-405e-85da-3900632ba168 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.214232 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e736-97cc-405e-85da-3900632ba168 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.214506 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e736-97cc-405e-85da-3900632ba168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.236176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] MFA Rules not processed for user `1113f4c427bf436db0e8b1af2cf9123c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:38.238640 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:38.258588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a955e736-97cc-405e-85da-3900632ba168 None None] MFA Rules not processed for user `942e9e108f144003b63c6be450a4a2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:38.259801 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a955e736-97cc-405e-85da-3900632ba168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:38.322539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1308/2638] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:38.327259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.368715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1331/2639] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:38.373108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e736-97cc-405e-85da-3900632ba168 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.416609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55511a-e509-42c7-96a3-4e827d60957b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.421298 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.422225 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.422500 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.422767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.423666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.425770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.447992 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e736-97cc-405e-85da-3900632ba168 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.455115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.455733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.456171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.456484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.457276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.459142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.468179 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1309/2640] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.470108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:38.470670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.498443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1332/2641] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.500761 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.526003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:38.546018 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c494-d3d3-46c9-ba4e-9e96a74830df admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.582828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99311469-b2e6-484e-93be-1e256ee84f6c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.591435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.592247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.592601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.592969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.593969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.596495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.617823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.618529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.618805 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.619095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.619791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.621837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.624233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1333/2642] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:38.625448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.638760 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4beea2-a3e0-4459-8e3e-e04a129712c7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.645604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.647778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.648051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1310/2643] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/users => generated 310 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.648213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.648381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.649070 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.650754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.651766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.662752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be53a-9e27-4256-95f7-70c82a02244a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.663173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1334/2644] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:38.667694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.669587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.670311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.670681 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.671057 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.671791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.673570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.688565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1311/2645] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:38.691068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.692133 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6948fd-1699-48f9-8698-1adfca53edd7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.698485 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.699156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.699440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.699819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.700518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.702100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.702902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928fe75-5cf9-4516-ab67-e1d62a056ff2 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.711358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.712152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.712543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.713008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] PATH_INFO: `/v3/projects/31b3f147e72f4a529a6344ade5810cb7/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.717060 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1335/2646] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:38.718010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.729645 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b7fc-8255-473b-b555-56a9b3ba726b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.734509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b3f147e72f4a529a6344ade5810cb7, user_id=f3fb39f06fc44a9c9fb1eb7f1ac4c855, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.735369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.736036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.736361 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.736639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] PATH_INFO: `/v3/projects/1c5db38df34b4047876987796ac5488a/users/179d435f076c4b359c1c68f63783043e/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.739638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.754947 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5db38df34b4047876987796ac5488a, user_id=179d435f076c4b359c1c68f63783043e, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.755251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1312/2647] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:38 2022] PUT /identity/v3/projects/31b3f147e72f4a529a6344ade5810cb7/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:38.757866 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa6b5-4324-433c-ab11-3d455c047ca7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.759377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.771708 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1336/2648] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:38 2022] PUT /identity/v3/projects/1c5db38df34b4047876987796ac5488a/users/179d435f076c4b359c1c68f63783043e/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:38.781939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.782225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.782497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.810490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] MFA Rules not processed for user `179d435f076c4b359c1c68f63783043e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:38.811729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:38.822580 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e942b0-54a4-40bb-94ce-13f4e1006bca admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.876561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1337/2649] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:38.880982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.881456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:38.883687 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.884328 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.884613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.885131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.886007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.888182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.892991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903df44-3d70-438a-a9b8-b483b7ff953f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.898202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.898791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.898914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1313/2650] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:38.899067 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.899337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.899972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.902105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.902867 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.912324 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366241c8-d52d-47f1-97fc-f3e103f19402 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:38.917472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:38.918117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.918391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.918655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] PATH_INFO: `/v3/projects/31b3f147e72f4a529a6344ade5810cb7/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.920759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b3f147e72f4a529a6344ade5810cb7, user_id=f3fb39f06fc44a9c9fb1eb7f1ac4c855, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:38.923660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185eaa6-dc95-4ce1-a895-00457e8a772d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:38.924259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:38.934306 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1338/2651] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:38.934647 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1314/2652] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:38 2022] PUT /identity/v3/projects/31b3f147e72f4a529a6344ade5810cb7/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:38.935234 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:38.944636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:38.944912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:38.945171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:38.973193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] MFA Rules not processed for user `f3fb39f06fc44a9c9fb1eb7f1ac4c855`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:38.974306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:38.998702 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63075a-9ff2-48f5-a05f-6581fb07b170 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.003285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.003883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.004200 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.004460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.005077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.007572 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.028834 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1339/2653] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:39.032763 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.042659 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61547-d584-405c-9aaa-06b0b097fa72 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.045784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1315/2654] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:38 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:39.047798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.048518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.048869 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.049337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.050000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.051582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.056446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.057947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:39.065689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1340/2655] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:39.066836 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.076099 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe23c-e11b-48cb-81da-69cb9154969c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.080585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.081202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.081478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.081747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] PATH_INFO: `/v3/projects/8312d5a5295849fa9c7d241ed7debd5f/users/ed3b7b48f42142478f0baa1830ea56e3/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.097267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8312d5a5295849fa9c7d241ed7debd5f, user_id=ed3b7b48f42142478f0baa1830ea56e3, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.100020 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.114064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1341/2656] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:39 2022] PUT /identity/v3/projects/8312d5a5295849fa9c7d241ed7debd5f/users/ed3b7b48f42142478f0baa1830ea56e3/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:39.117464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81da13-d660-429f-83a3-988056cd0552 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.118272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.167628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.168261 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.168542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.168806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.180219 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f738c8-c2b9-4da7-bfaf-d47ff2615962 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.184826 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.185426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.185704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.185982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.186613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.188229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.198525 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1342/2657] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:39.202529 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.202793 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:39.213725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd0d5-77bc-4534-b53b-b6904b5f082a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.218509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.219157 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.219469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.219850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] PATH_INFO: `/v3/projects/8312d5a5295849fa9c7d241ed7debd5f/users/ed3b7b48f42142478f0baa1830ea56e3/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.221831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8312d5a5295849fa9c7d241ed7debd5f, user_id=ed3b7b48f42142478f0baa1830ea56e3, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.224531 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc13cf1-3713-4f70-99a4-78492a77a815 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.232156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.233699 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.235166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1343/2658] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:39 2022] PUT /identity/v3/projects/8312d5a5295849fa9c7d241ed7debd5f/users/ed3b7b48f42142478f0baa1830ea56e3/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:39.244293 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1316/2659] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:39 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:39.245838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.246202 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.246543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.273495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] MFA Rules not processed for user `ed3b7b48f42142478f0baa1830ea56e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:39.274913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:39.303923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:39.348420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1344/2660] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:39.361444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.370641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22276f2c-1baf-4c32-bc8d-10cf9cbff7c1 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.398663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:39.400147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:39.420599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.421200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.421476 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.421742 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.462917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade1cee-5ef5-43f8-8772-9853fc922896 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:39.466719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:39.467374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:39.467652 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:39.467951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:39.477100 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.478545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.487398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1317/2661] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:39.528221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:39.530455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:39.539809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1345/2662] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:41.049076 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:41.060405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e64a6-f0a2-4025-be1c-837889c58a19 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:41.064996 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:41.065814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:41.066026 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:41.066569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:41.139460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:41.141156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:41.153664 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1318/2663] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:41.699730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:41.708293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f98a-10b1-443f-9575-daa1aceccd6a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:41.712429 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:41.713016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:41.713298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:41.713563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:41.722565 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:41.723979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:41.733540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1346/2664] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:44.920439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:44.948561 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:44.967242 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:44.968738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:44.990045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cf02d-eb44-4a13-b7c7-9f1bc5f499cd service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:44.994751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:44.995506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:44.995826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:44.996127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] PATH_INFO: `/v3/users/1113f4c427bf436db0e8b1af2cf9123c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:44.997260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1113f4c427bf436db0e8b1af2cf9123c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:44.999182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:45.035961 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de566fb-c6bf-4d4a-9efd-7d8decaa5951 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:45.041274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:45.041912 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.042312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.042594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] PATH_INFO: `/v3/users/655ec907dc9440ffaf4666c24a91c2be` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.043709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655ec907dc9440ffaf4666c24a91c2be)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:45.045679 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:45.047065 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1113f4c427bf436db0e8b1af2cf9123c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.047737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1113f4c427bf436db0e8b1af2cf9123c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.050321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:45.056278 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1113f4c427bf436db0e8b1af2cf9123c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.064036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1113f4c427bf436db0e8b1af2cf9123c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.064829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ae25502-6073-43b9-9a51-691078c551db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1113f4c427bf436db0e8b1af2cf9123c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.083260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1319/2665] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:44 2022] DELETE /identity/v3/users/1113f4c427bf436db0e8b1af2cf9123c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:45.088426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.089121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.089401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.100235 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655ec907dc9440ffaf4666c24a91c2be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.101455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655ec907dc9440ffaf4666c24a91c2be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.108897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:45.110079 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.114077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655ec907dc9440ffaf4666c24a91c2be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.114739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655ec907dc9440ffaf4666c24a91c2be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.122773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96dbf429-3e40-4ace-a933-fad0d5d36b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655ec907dc9440ffaf4666c24a91c2be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.135703 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1347/2666] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:44 2022] DELETE /identity/v3/users/655ec907dc9440ffaf4666c24a91c2be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:45.140046 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.140358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.140630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.159276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:45.160523 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.169595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1320/2667] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:45.180890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:45.182490 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.219842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1348/2668] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:45.228941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:45.229473 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:45.231472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.241251 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d29ec-043f-49b8-b0bc-91423d143efc None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:45.291007 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e9b8a-f5ed-4a44-a8d5-89551a942a15 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:45.291913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:45.292548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.292824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.293089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.294785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:45.295415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.295692 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.296077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.302739 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:45.304271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:45.305184 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:45.306623 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f9c3-0630-44a1-b575-c63b19a5eb81 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:45.313437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1321/2669] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:45.315901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1349/2670] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:45.607441 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:45.608886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.622360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75cd47-f78a-4771-b3d9-889b06d86758 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:45.628010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:45.628796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.629291 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.629658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] PATH_INFO: `/v3/users/942e9e108f144003b63c6be450a4a2c1` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.630874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942e9e108f144003b63c6be450a4a2c1)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:45.633802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:45.720731 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942e9e108f144003b63c6be450a4a2c1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.721516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942e9e108f144003b63c6be450a4a2c1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.739499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942e9e108f144003b63c6be450a4a2c1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.752985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942e9e108f144003b63c6be450a4a2c1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.754279 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942e9e108f144003b63c6be450a4a2c1'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:45.784105 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1322/2671] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:45 2022] DELETE /identity/v3/users/942e9e108f144003b63c6be450a4a2c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:45.787148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:45.787466 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:45.788111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:45.813938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:45.815165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:45.848017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:45.917233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1350/2672] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:45.927903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:45.929942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.025770 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392c05-ff1a-4fad-aa63-b9a0e40ee5c8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.030889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.031536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.031817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.032138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.046481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.048150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.060670 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1323/2673] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:46.074088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.075727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.088174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d365fad-d1fc-4f3d-9066-ae022133e51a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.093294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.094291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.094576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.094848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] PATH_INFO: `/v3/projects/5db112db1ab74050906e2594ef2c04c3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.096676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db112db1ab74050906e2594ef2c04c3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.098136 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.153310 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db112db1ab74050906e2594ef2c04c3', 'request_id': 'req-70ae33c6-440f-41d3-919c-d68cef6dc24a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.153528 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.155628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.161382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db112db1ab74050906e2594ef2c04c3', 'request_id': 'req-70ae33c6-440f-41d3-919c-d68cef6dc24a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.172338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e59e-4447-427b-8ec9-7ed49670876f service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.175686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db112db1ab74050906e2594ef2c04c3', 'request_id': 'req-70ae33c6-440f-41d3-919c-d68cef6dc24a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.191598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:46.204338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] The token cache is being invalidate because project 5db112db1ab74050906e2594ef2c04c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:46.204619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.205275 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.208302 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1351/2674] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/projects/5db112db1ab74050906e2594ef2c04c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:46.212395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.214011 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.249188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.251667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.252458 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.253126 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] PATH_INFO: `/v3/projects/d74a7012ff064aef868addd85df8993e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.256958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74a7012ff064aef868addd85df8993e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.259887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.322299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae33c6-440f-41d3-919c-d68cef6dc24a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.331044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74a7012ff064aef868addd85df8993e', 'request_id': 'req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.356683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74a7012ff064aef868addd85df8993e', 'request_id': 'req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.369159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74a7012ff064aef868addd85df8993e', 'request_id': 'req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.385042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] The token cache is being invalidate because project d74a7012ff064aef868addd85df8993e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:46.385369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.386002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.387717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1324/2675] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/projects/d74a7012ff064aef868addd85df8993e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:46.391378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.393047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.407668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:46.423317 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.424294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.424448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.424736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] PATH_INFO: `/v3/users/085bd3c1e48b4634b0025980bf6dfd27` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.425982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085bd3c1e48b4634b0025980bf6dfd27)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.427982 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.468860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee11f-1cb1-4d0b-8e45-0e73d2a1850a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.473636 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.474260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.474535 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.474804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] PATH_INFO: `/v3/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.476512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fb39f06fc44a9c9fb1eb7f1ac4c855)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.478423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.485879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085bd3c1e48b4634b0025980bf6dfd27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.486548 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085bd3c1e48b4634b0025980bf6dfd27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.500015 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085bd3c1e48b4634b0025980bf6dfd27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.500732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085bd3c1e48b4634b0025980bf6dfd27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.508690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085bd3c1e48b4634b0025980bf6dfd27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.521277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1352/2676] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/users/085bd3c1e48b4634b0025980bf6dfd27 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:46.524855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.524855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.528845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fb39f06fc44a9c9fb1eb7f1ac4c855'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.529700 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fb39f06fc44a9c9fb1eb7f1ac4c855'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.532351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:46.538926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fb39f06fc44a9c9fb1eb7f1ac4c855'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.550617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fb39f06fc44a9c9fb1eb7f1ac4c855'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.551435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fb39f06fc44a9c9fb1eb7f1ac4c855'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.573560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1325/2677] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/users/f3fb39f06fc44a9c9fb1eb7f1ac4c855 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:46.606778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0170-42dd-491f-bec3-ab19c828db35 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.675730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.676543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.676896 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.677177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] PATH_INFO: `/v3/projects/0ac0022a059f48f487b7b1b27bc1eb02` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.678735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac0022a059f48f487b7b1b27bc1eb02)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.682441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.737551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:46.761352 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac0022a059f48f487b7b1b27bc1eb02', 'request_id': 'req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.768884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac0022a059f48f487b7b1b27bc1eb02', 'request_id': 'req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.777512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac0022a059f48f487b7b1b27bc1eb02', 'request_id': 'req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.794353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] The token cache is being invalidate because project 0ac0022a059f48f487b7b1b27bc1eb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:46.794648 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.795321 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.797086 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1353/2678] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/projects/0ac0022a059f48f487b7b1b27bc1eb02 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:46.801194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.802748 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.821232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f338-b8cb-40eb-b302-394cf7d1b64b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:46.841955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:46.843889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:46.922902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:46.923584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:46.923868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:46.924176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] PATH_INFO: `/v3/users/179d435f076c4b359c1c68f63783043e` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:46.926613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=179d435f076c4b359c1c68f63783043e)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:46.928720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:46.995613 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179d435f076c4b359c1c68f63783043e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:46.996462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179d435f076c4b359c1c68f63783043e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.005724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179d435f076c4b359c1c68f63783043e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.021556 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179d435f076c4b359c1c68f63783043e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.024152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179d435f076c4b359c1c68f63783043e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.044104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1326/2679] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/users/179d435f076c4b359c1c68f63783043e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:47.047068 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6d4d-a65a-47a2-822d-d3ec3bc705ac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.048300 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.049899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.111720 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.133369 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.134111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.134308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.134969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] PATH_INFO: `/v3/projects/fc00a81a31124a53943227fd20438d1a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.136460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc00a81a31124a53943227fd20438d1a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.137870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fbf99-3ba1-4ce3-9910-dfe2d9713cfe admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.138475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.145602 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.146818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.147137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.147486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] PATH_INFO: `/v3/projects/31b3f147e72f4a529a6344ade5810cb7` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.149594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b3f147e72f4a529a6344ade5810cb7)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.152648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.197576 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc00a81a31124a53943227fd20438d1a', 'request_id': 'req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.204106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc00a81a31124a53943227fd20438d1a', 'request_id': 'req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.211170 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc00a81a31124a53943227fd20438d1a', 'request_id': 'req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.211350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b3f147e72f4a529a6344ade5810cb7', 'request_id': 'req-b088a969-bb31-4390-880e-2523530cf1cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.213290 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.220002 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b3f147e72f4a529a6344ade5810cb7', 'request_id': 'req-b088a969-bb31-4390-880e-2523530cf1cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.229640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] The token cache is being invalidate because project fc00a81a31124a53943227fd20438d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:47.229640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.230340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.231999 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1354/2680] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:46 2022] DELETE /identity/v3/projects/fc00a81a31124a53943227fd20438d1a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:47.232850 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.235634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.235801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b3f147e72f4a529a6344ade5810cb7', 'request_id': 'req-b088a969-bb31-4390-880e-2523530cf1cd'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.248451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] The token cache is being invalidate because project 31b3f147e72f4a529a6344ade5810cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:47.248732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.249450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-b088a969-bb31-4390-880e-2523530cf1cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.251164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1327/2681] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:47 2022] DELETE /identity/v3/projects/31b3f147e72f4a529a6344ade5810cb7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:47.255631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7697ee-ad64-4e4a-aeb8-77f31d7ef01b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.255631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7697ee-ad64-4e4a-aeb8-77f31d7ef01b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.255887 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7697ee-ad64-4e4a-aeb8-77f31d7ef01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.276389 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3b7697ee-ad64-4e4a-aeb8-77f31d7ef01b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:47.277603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3b7697ee-ad64-4e4a-aeb8-77f31d7ef01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.307214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7571a4-356a-4d77-bafb-e37f3fd67e5d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.344242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1328/2682] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:47.351882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd067-f4bb-49b8-af4c-5db5c4e6ca89 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.352196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd067-f4bb-49b8-af4c-5db5c4e6ca89 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.352473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd067-f4bb-49b8-af4c-5db5c4e6ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.364941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.365600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.365890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.366776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.368876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.374460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fa6fd067-f4bb-49b8-af4c-5db5c4e6ca89 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:47.375691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fa6fd067-f4bb-49b8-af4c-5db5c4e6ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.380293 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.382610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.388127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1329/2683] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:47.388127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd30f-1481-417d-9661-8a7d0c242515 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.388127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd30f-1481-417d-9661-8a7d0c242515 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.388127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd30f-1481-417d-9661-8a7d0c242515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.394064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1355/2684] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:47.397071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.398538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.411271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-9d7fd30f-1481-417d-9661-8a7d0c242515 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:47.413518 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9d7fd30f-1481-417d-9661-8a7d0c242515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.419404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4301146-71e4-4f3f-bd04-71570fa51445 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.424217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1330/2685] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:47.425539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.425732 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.426022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.426320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.426963 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.427488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.428166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] PATH_INFO: `/v3/projects/1c5db38df34b4047876987796ac5488a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.430295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5db38df34b4047876987796ac5488a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.433855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.451017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:47.452524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.460975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1331/2686] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:47.461965 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.472051 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed653-a64e-4548-a0ef-d62386678e65 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.478063 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.478662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.478927 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.479202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.479928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:47.480320 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.482123 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.495977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1332/2687] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:47.499679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.510422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da97f-c747-44df-a6c8-59afed156dbd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.511358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5db38df34b4047876987796ac5488a', 'request_id': 'req-6c11957f-b989-41b6-ad15-841f3d75ce81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.521586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5db38df34b4047876987796ac5488a', 'request_id': 'req-6c11957f-b989-41b6-ad15-841f3d75ce81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.530615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5db38df34b4047876987796ac5488a', 'request_id': 'req-6c11957f-b989-41b6-ad15-841f3d75ce81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.545847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] The token cache is being invalidate because project 1c5db38df34b4047876987796ac5488a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:47.546406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.547285 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.548988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1356/2688] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:47 2022] DELETE /identity/v3/projects/1c5db38df34b4047876987796ac5488a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:47.549998 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.551853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.569437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.591642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.592442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.592715 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.592980 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.593614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:47.593908 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.595678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ad154-ea6d-4f85-9f95-2a7d29e6517f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.603309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.610871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1333/2689] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:47.612092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.612386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.612686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] PATH_INFO: `/` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.613910 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1334/2690] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:47:47.620245 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.621977 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.637738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7f99-1f4f-46e7-aa34-f61b76af0fef None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.639682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11957f-b989-41b6-ad15-841f3d75ce81 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.642428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.643047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.643326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.643630 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] PATH_INFO: `/v3/users/ed3b7b48f42142478f0baa1830ea56e3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.644567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.644769 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3b7b48f42142478f0baa1830ea56e3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.645295 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.645573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.645840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.646488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.646684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.648471 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.677308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1357/2691] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:47.678438 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.681039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.709101 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3b7b48f42142478f0baa1830ea56e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.709761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3b7b48f42142478f0baa1830ea56e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.718588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3b7b48f42142478f0baa1830ea56e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.729454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3b7b48f42142478f0baa1830ea56e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.730277 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-0ed031ce-6803-4f9b-91df-7799ac9c88e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3b7b48f42142478f0baa1830ea56e3'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:47.750953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1335/2692] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:47 2022] DELETE /identity/v3/users/ed3b7b48f42142478f0baa1830ea56e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:47.751731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa4501-ae97-4ac5-866a-f52227e0e773 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.752488 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.752871 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.753297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.773620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] MFA Rules not processed for user `2be1be9e39a74168887220f2a4cc20d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:47.774868 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.814400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.815036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.815312 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.815577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.816223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.818108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.843250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1336/2693] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:47.844372 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.845642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.849567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1358/2694] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:47.854279 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.858125 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.865473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34d95c-7ea0-4f49-9032-a97e8453096b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.922128 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.926622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.927237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.927667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.928302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.929104 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.931311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.938277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56481a1-ede1-4300-bcb9-5b47b0dcc059 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.941171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:47.944233 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.944867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.945166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.945401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.946028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.948586 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:47.959701 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1337/2695] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:47.961749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.964032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:47.972872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1359/2696] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:47 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:47.977146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:47.987412 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2e2c-abb2-4813-9d24-d6542e5cd5d2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:47.992442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:47.993037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:47.993578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:47.993578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:47.994351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:47.995946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.012364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1360/2697] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.013259 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.023277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb19724-54a0-4d00-8ac7-09cd0c6196a0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.028681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.029272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.029872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.029872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.030418 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.030817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6a3c-d4aa-47d6-bab0-d3ca3bb4f3d8 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.031985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.034738 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.035412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.035760 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.036131 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.042630 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1361/2698] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.045058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.050112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.051884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.058432 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2031b3-431e-4cea-990b-9307778ed2ba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.062912 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1338/2699] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:48.063737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.065265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.065919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.066199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.066474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.067596 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.069483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.076367 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27550190-6015-4009-8743-68f954a3f5ab service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.081190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.081816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1362/2700] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.084828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.085646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.085924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.086319 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.086563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.088178 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.099056 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3502f9-012a-455d-a57d-793394c0d72c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.099327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1339/2701] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.103692 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.104641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.105320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.105601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.105876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] PATH_INFO: `/v3/projects/253c32c647f740b582ceb067f12006ee/users/5cd6d2f32e6244c8952af7e96ab15900/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.106266 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.123465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=253c32c647f740b582ceb067f12006ee, user_id=5cd6d2f32e6244c8952af7e96ab15900, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.126447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.129349 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f328b-adfc-4aba-881b-fcf167144cb7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.142247 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.143031 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.143431 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.143774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1363/2702] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:48 2022] PUT /identity/v3/projects/253c32c647f740b582ceb067f12006ee/users/5cd6d2f32e6244c8952af7e96ab15900/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:48.144618 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.148235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] PATH_INFO: `/v3/projects/8312d5a5295849fa9c7d241ed7debd5f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.151506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8312d5a5295849fa9c7d241ed7debd5f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.154294 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.206873 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8312d5a5295849fa9c7d241ed7debd5f', 'request_id': 'req-e0e6698c-2770-4fcb-a693-d7b87c133aae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:48.211723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a341e-bac6-4610-b1d7-2ced62b3fdea admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.213102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8312d5a5295849fa9c7d241ed7debd5f', 'request_id': 'req-e0e6698c-2770-4fcb-a693-d7b87c133aae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:48.221118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8312d5a5295849fa9c7d241ed7debd5f', 'request_id': 'req-e0e6698c-2770-4fcb-a693-d7b87c133aae'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:48.233303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] The token cache is being invalidate because project 8312d5a5295849fa9c7d241ed7debd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:48.233624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:48.234268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-e0e6698c-2770-4fcb-a693-d7b87c133aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:48.235870 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1340/2703] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:48 2022] DELETE /identity/v3/projects/8312d5a5295849fa9c7d241ed7debd5f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:48.239258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ce2-67b3-4189-a7bb-ba8fad6246f8 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.239258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ce2-67b3-4189-a7bb-ba8fad6246f8 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.239258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01ce2-67b3-4189-a7bb-ba8fad6246f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.265237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-c3e01ce2-67b3-4189-a7bb-ba8fad6246f8 None None] MFA Rules not processed for user `5cd6d2f32e6244c8952af7e96ab15900`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:48.266483 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-c3e01ce2-67b3-4189-a7bb-ba8fad6246f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.271326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.272211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.272354 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.273199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] PATH_INFO: `/v3/projects/9c6f6a03d0374cbd890613902150238e/users/b9097023624f43cfb4c86bd680ae496c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.289678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6f6a03d0374cbd890613902150238e, user_id=b9097023624f43cfb4c86bd680ae496c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.292622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea3fd-84ce-46a1-ad2f-76e400b3222e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.305919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1364/2704] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:48 2022] PUT /identity/v3/projects/9c6f6a03d0374cbd890613902150238e/users/b9097023624f43cfb4c86bd680ae496c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:48.307074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a6ae-8173-48a7-8744-d2623635d41c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.307358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a6ae-8173-48a7-8744-d2623635d41c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.307766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a6ae-8173-48a7-8744-d2623635d41c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.309124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1365/2705] 10.222.0.73 () {54 vars in 921 bytes} [Thu Aug 18 16:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:47:48.310053 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90bc9-20be-427a-93cc-511b42c73416 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.310330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90bc9-20be-427a-93cc-511b42c73416 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.310594 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90bc9-20be-427a-93cc-511b42c73416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.325672 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:48.331664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fce90bc9-20be-427a-93cc-511b42c73416 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:48.332941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fce90bc9-20be-427a-93cc-511b42c73416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.337953 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1341/2706] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:48.339197 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.339642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.339917 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.345000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:48.359633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] MFA Rules not processed for user `92d15db5127347b8b25cdf41abb2ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:48.360810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.396700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1366/2707] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:48.403711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.403711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.403711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.426120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] MFA Rules not processed for user `b9097023624f43cfb4c86bd680ae496c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:48.427601 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.434512 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1342/2708] 10.222.0.73 () {58 vars in 1018 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:48.435338 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.436650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.450231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538fdc2-1db5-4026-ba91-a6688287a40e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.454782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.455377 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.455660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.455934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.456611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.458501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d234aa-4def-465f-81a0-79044948bb1b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.486804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1343/2709] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:48.487857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.488171 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.488443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.504433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1367/2710] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:48.505691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.507742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.508336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:48.509579 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.577541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc315-d8e0-4bcf-b196-e921530e39ae None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.582844 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1344/2711] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:48.583480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.593077 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a197e5-9583-4a4d-a1f1-146675af4397 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.597685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.598437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.598559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.598803 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.599409 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.601401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.630415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1345/2712] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:48.631271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.634437 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:48.639856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.641037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.641037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.641809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.650854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe050-aab0-4df3-81ee-2c21e1fe872f admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.655395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:48.657585 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.658850 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.659134 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.659405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.660030 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.661983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.705034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1346/2713] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:48.705948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.728954 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.730391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.734962 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:48.743678 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1368/2714] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:48.744581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.758865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526812-b70e-4f80-9a53-4b04cc84c61e service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.784492 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbbe83-d06b-4ace-9a44-62a6197f6ae7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.790744 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.791386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.791752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.792008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.792682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:48.792970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.794588 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.807866 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1347/2715] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:48.809260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.822472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cec9a2-677b-4b3a-8634-f6604ee571e5 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.829823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1876-25da-4223-806f-830e83900791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.830718 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1876-25da-4223-806f-830e83900791 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.831152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1876-25da-4223-806f-830e83900791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.831592 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1876-25da-4223-806f-830e83900791 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.832398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1876-25da-4223-806f-830e83900791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.834971 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1876-25da-4223-806f-830e83900791 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.859286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.859930 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.860287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.860689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.861538 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.863347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.870115 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1348/2716] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/users => generated 299 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:48.871107 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1876-25da-4223-806f-830e83900791 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.879022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1369/2717] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.880005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.882594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1876-25da-4223-806f-830e83900791 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.888477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.889117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.890036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.890317 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.891237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.893216 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.893723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57779b-bb44-489d-9605-82dd8e4cd734 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:48.901667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:48.902343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:48.902629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:48.902902 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:48.903549 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:48.905510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:48.924699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1370/2718] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:48.924699 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.929915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1349/2719] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:48 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:48.932050 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:48.935491 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcaff99-9a6e-4f78-96e1-0d07a55114b8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.000378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.001082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.003234 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b417c1a-022a-4bac-bc62-7c163ad04762 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.003577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.003915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.004649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.006518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.013766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.014766 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.014973 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.015315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] PATH_INFO: `/v3/projects/81a9187aa1624aafaf0a3b33cbb52940/users/29deb0f45174499b979a263a33fdbd04/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.022196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1371/2720] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:49.022196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.031870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d608a0-0da5-4e91-a63a-62a307ca2e6a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.033807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a9187aa1624aafaf0a3b33cbb52940, user_id=29deb0f45174499b979a263a33fdbd04, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.036569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.037330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.038600 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.038943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.039386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.039936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.041993 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.051673 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1350/2721] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:48 2022] PUT /identity/v3/projects/81a9187aa1624aafaf0a3b33cbb52940/users/29deb0f45174499b979a263a33fdbd04/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:49.052758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.067662 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1372/2722] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:49.068889 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.076323 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:49.080244 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ff5e-d61c-4e79-bf80-cac457af7ae0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.126819 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1227c5-1022-4369-8765-d31555f4da52 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.132638 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.133763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.134128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.134493 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] PATH_INFO: `/v3/projects/a544d31bb6d8467a96e007e8385292df/users/431fc9b85dce41d98896821415f99d8b/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.138969 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:49.148771 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.150096 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.150687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.151335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.151988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.153721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.155526 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a544d31bb6d8467a96e007e8385292df, user_id=431fc9b85dce41d98896821415f99d8b, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.158392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.166688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1373/2723] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:49.167544 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.174221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1351/2724] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:49 2022] PUT /identity/v3/projects/a544d31bb6d8467a96e007e8385292df/users/431fc9b85dce41d98896821415f99d8b/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:49.175184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.179676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb8d-5588-429c-a64e-bfdcc1c94921 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.248217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cf8a2-338c-4819-8837-c1d01b954109 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.253150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.253811 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.254095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.254215 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.254373 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] PATH_INFO: `/v3/projects/81a9187aa1624aafaf0a3b33cbb52940/users/29deb0f45174499b979a263a33fdbd04/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.255689 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.256036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.256311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a9187aa1624aafaf0a3b33cbb52940, user_id=29deb0f45174499b979a263a33fdbd04, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.256550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.257921 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.259824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a441f-9c34-4132-9575-7fa281ed661f admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.259953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.283025 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1352/2725] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:49 2022] PUT /identity/v3/projects/81a9187aa1624aafaf0a3b33cbb52940/users/29deb0f45174499b979a263a33fdbd04/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:49.283247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1374/2726] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:49.283354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.283354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.283354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.283624 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.291009 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86dce-dc8e-4ab9-acd3-341ac6b19c96 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.308761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] MFA Rules not processed for user `431fc9b85dce41d98896821415f99d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:49.309960 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:49.354920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.355357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.355711 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.356106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.356828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.358490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dba52f-7b81-4b39-b0bd-74f94ea51d09 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.370105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1375/2727] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:47:49.374854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e247-1e8c-4327-a6b0-a9e6ef7fd214 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.375143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e247-1e8c-4327-a6b0-a9e6ef7fd214 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.375493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e247-1e8c-4327-a6b0-a9e6ef7fd214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.389011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1353/2728] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:49.390013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.400730 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eac1c-d098-446c-9627-3a53675383ad None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.405958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.406661 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.407012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.407336 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5301e247-1e8c-4327-a6b0-a9e6ef7fd214 None None] MFA Rules not processed for user `29deb0f45174499b979a263a33fdbd04`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:49.407438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] PATH_INFO: `/v3/projects/218e2bb8016e4914bf273ce2b36a49f9/users/855304c2eae64820bd69c2d1038ea61a/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.408626 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5301e247-1e8c-4327-a6b0-a9e6ef7fd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:49.423937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218e2bb8016e4914bf273ce2b36a49f9, user_id=855304c2eae64820bd69c2d1038ea61a, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.426680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.430121 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:49.440668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1354/2729] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:49 2022] PUT /identity/v3/projects/218e2bb8016e4914bf273ce2b36a49f9/users/855304c2eae64820bd69c2d1038ea61a/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:49.446274 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.488561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1376/2730] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:49.489851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.490137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.490408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.501122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:49.518873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:49.520883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:49.523507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c702d-dc8a-43b0-bc2a-a8dae4acb529 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.529212 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.530315 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.530598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.530889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.531484 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.533517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.534539 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1377/2731] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:49.535363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.536694 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:49.570659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1355/2732] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:49.570659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.604513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da763cb5-d780-44ba-9bc6-ec6953a67da6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.632486 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9fed3-84ea-4769-b9e0-018d0e70c664 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.636393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.636995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.637270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.637549 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.656292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.657467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.657909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.658183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.713355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.714804 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.731768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1356/2733] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:49.731768 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.738169 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483704-9ba9-4cbc-8ccb-0dd151ceafee service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.743165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.745287 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.745741 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.746363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.746645 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.746926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.747607 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.750473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.757732 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1378/2734] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:49.782110 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1357/2735] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:49 2022] POST /identity/v3/users => generated 300 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:49.786343 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.799367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffab39-0561-409a-b3f5-4587d6522999 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.811333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.812037 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.812414 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.812745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.813449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.815146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.826194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1379/2736] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:49.830405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.842003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff4905-d90c-4cad-af7e-a08d96f1dc9d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.848218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.848890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.849196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.849789 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] PATH_INFO: `/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa/users/76c3cffbea21469794a2cd3350abb1d4/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.870954 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ef54d1a3dd40a9b3d12b2e108d3cfa, user_id=76c3cffbea21469794a2cd3350abb1d4, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:49.874283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:49.891466 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1358/2737] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:49 2022] PUT /identity/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa/users/76c3cffbea21469794a2cd3350abb1d4/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:49.895589 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:49.908339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356be2-585e-48e0-ac45-f3991b029da1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:49.913620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:49.997389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:49.998036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:49.998309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:49.998680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:49.999222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:50.000879 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e70b9-b1b5-4aa5-97b6-bb54a19c3135 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:50.028681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1380/2738] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:50.033143 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:50.043612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268296-50c6-4961-9643-b7ce7262717c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:50.048777 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:50.049563 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.049933 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.050352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] PATH_INFO: `/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa/users/76c3cffbea21469794a2cd3350abb1d4/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.052426 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ef54d1a3dd40a9b3d12b2e108d3cfa, user_id=76c3cffbea21469794a2cd3350abb1d4, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:50.055860 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:50.077628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1359/2739] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:50 2022] PUT /identity/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa/users/76c3cffbea21469794a2cd3350abb1d4/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:50.089127 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.089411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.089687 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.125360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] MFA Rules not processed for user `76c3cffbea21469794a2cd3350abb1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:50.126566 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:50.227695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1381/2740] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:50.239460 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:50.242270 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:50.283042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:50.343861 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bdad2-b4b7-4864-8bde-b99112311bf6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:50.349081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:50.349890 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.350342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.350773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.375513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:50.377156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8aa87-378b-4466-b4db-2641a176a7d4 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:50.389626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1360/2741] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:50.546241 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:50.654052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.654340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.654615 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.671225 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e21e1e-1287-4ab7-956a-838572729de4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:50.681592 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:50.682382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.682776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.683120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] PATH_INFO: `/v3/users/b9097023624f43cfb4c86bd680ae496c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.684497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9097023624f43cfb4c86bd680ae496c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:50.687214 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:50.721401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] MFA Rules not processed for user `855304c2eae64820bd69c2d1038ea61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:50.724829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:50.756791 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:50.778379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9097023624f43cfb4c86bd680ae496c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:50.779129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9097023624f43cfb4c86bd680ae496c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:50.800337 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9097023624f43cfb4c86bd680ae496c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:50.802376 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9097023624f43cfb4c86bd680ae496c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:50.818705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e2352177-0997-4c8e-bce2-e1eef077a5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9097023624f43cfb4c86bd680ae496c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:50.838168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1382/2742] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:50 2022] DELETE /identity/v3/users/b9097023624f43cfb4c86bd680ae496c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:50.842291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.843017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.843457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.863351 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1361/2743] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:50.868400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:50.869717 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:50.876089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:50.878523 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:50.893418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd73d5-18ba-44ec-8543-d8d12d284e12 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:50.941878 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1383/2744] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:50.949941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:50.950682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:50.951038 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:50.951412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:50.952980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:50.954495 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:51.018875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ee6e-dc2c-49c3-8c6f-966f33564fdf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:51.023106 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:51.023722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:51.024033 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:51.024334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:51.032032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:51.033587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:51.033737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:51.035008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:51.045340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1362/2745] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:51.046669 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1384/2746] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:51.131439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:51.133432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:51.146003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9234a-5963-4241-90f7-43d78bf4bcba service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:51.150899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:51.151778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:51.152155 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:51.152417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:51.154182 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:51.164818 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:51.235780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:51.237258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:51.247878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1363/2747] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:51.365111 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:51.371262 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:51.412643 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300507d-5dae-4356-a0da-3cb6053578ce service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:51.429016 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:51.429443 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:51.429727 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:51.430001 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] PATH_INFO: `/v3/projects/9c6f6a03d0374cbd890613902150238e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:51.444124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6f6a03d0374cbd890613902150238e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:51.444124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:51.528871 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:51.530752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6f6a03d0374cbd890613902150238e', 'request_id': 'req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.547583 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6f6a03d0374cbd890613902150238e', 'request_id': 'req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.563245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6f6a03d0374cbd890613902150238e', 'request_id': 'req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.587129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] The token cache is being invalidate because project 9c6f6a03d0374cbd890613902150238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:51.587563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.588396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.590519 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1385/2748] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:51 2022] DELETE /identity/v3/projects/9c6f6a03d0374cbd890613902150238e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:51.594350 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:51.607090 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d68cba-27e9-4892-a058-180b49980580 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:51.679509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:51.680396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:51.680778 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:51.680896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] PATH_INFO: `/v3/users/29deb0f45174499b979a263a33fdbd04` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:51.682190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29deb0f45174499b979a263a33fdbd04)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:51.684191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:51.734252 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29deb0f45174499b979a263a33fdbd04'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.734679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29deb0f45174499b979a263a33fdbd04'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.741536 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29deb0f45174499b979a263a33fdbd04'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.748454 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29deb0f45174499b979a263a33fdbd04'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.749074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a62f7ae7-6d24-4aba-8a13-6cbbc418ef9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29deb0f45174499b979a263a33fdbd04'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:51.766344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1364/2749] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:51 2022] DELETE /identity/v3/users/29deb0f45174499b979a263a33fdbd04 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:52.036655 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.038254 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.051611 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31074a6c-14bb-46a1-9bd4-c908dbc5c06e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.109174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.109802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.110082 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.110350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] PATH_INFO: `/v3/projects/81a9187aa1624aafaf0a3b33cbb52940` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.111470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a9187aa1624aafaf0a3b33cbb52940)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.113396 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.158146 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a9187aa1624aafaf0a3b33cbb52940', 'request_id': 'req-f2334b2d-b72e-4a09-8d27-9df8591c91a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:52.163735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a9187aa1624aafaf0a3b33cbb52940', 'request_id': 'req-f2334b2d-b72e-4a09-8d27-9df8591c91a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:52.169809 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a9187aa1624aafaf0a3b33cbb52940', 'request_id': 'req-f2334b2d-b72e-4a09-8d27-9df8591c91a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:52.181598 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] The token cache is being invalidate because project 81a9187aa1624aafaf0a3b33cbb52940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:52.181890 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:52.182515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2334b2d-b72e-4a09-8d27-9df8591c91a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:52.183978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1386/2750] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:52 2022] DELETE /identity/v3/projects/81a9187aa1624aafaf0a3b33cbb52940 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:52.188817 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.189290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.189475 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.209717 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:52.211562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.234363 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:52.269060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1365/2751] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:52.277722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.278120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.278400 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.300401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:52.301604 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.310139 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1387/2752] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:52.314133 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.324259 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ddf54-7a2c-4d13-9c06-1866fd6d813b None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.328758 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.329342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.329614 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.329878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.330502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:47:52.330798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.332388 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.343404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1366/2753] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:47:52.347609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.356584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14916521-d771-4a55-bf5c-4a620270f9b2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.361252 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.361837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.362115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.362387 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.363008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.364906 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.392078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1388/2754] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:47:52.396358 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.406244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e2393-5543-49e6-9339-6041f243dcc6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.460656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.461285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.461560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.461826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.462446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.464362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f5eb6-beec-4c8c-b715-8a4998c1b3ee admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.485958 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1367/2755] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:52.493340 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.504374 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0163b-b10b-4a6d-9563-ac38a3bc46a2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.509187 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bca78-5d87-4792-8923-1df1c21b91c4 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.509473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bca78-5d87-4792-8923-1df1c21b91c4 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.509746 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bca78-5d87-4792-8923-1df1c21b91c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.510733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.511159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.511512 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.511855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.512825 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.514881 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.529629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1389/2756] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:52.530852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-0a5bca78-5d87-4792-8923-1df1c21b91c4 None None] MFA Rules not processed for user `855304c2eae64820bd69c2d1038ea61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:52.532243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-0a5bca78-5d87-4792-8923-1df1c21b91c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.540165 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.557250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf47-019a-461f-ba3e-2ffdc8195f30 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.563364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.564427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.564427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.564700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.565811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.567442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.579382 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1390/2757] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:52.583408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.593469 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846daf03-e571-4afe-8b3f-af2d6599bcd7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.593646 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1368/2758] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:52.601391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.602237 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.602803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.602803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] PATH_INFO: `/v3/projects/73da19bd6dd34447bb7a8175438d58cc/users/b8dae8d8471349468e88401bc80d1aa4/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.615386 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:52.620578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73da19bd6dd34447bb7a8175438d58cc, user_id=b8dae8d8471349468e88401bc80d1aa4, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.623636 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.640092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1391/2759] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:52 2022] PUT /identity/v3/projects/73da19bd6dd34447bb7a8175438d58cc/users/b8dae8d8471349468e88401bc80d1aa4/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:52.645193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d952-63bf-47b5-a542-7151d77d4c74 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.645514 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d952-63bf-47b5-a542-7151d77d4c74 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.645952 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3d952-63bf-47b5-a542-7151d77d4c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.703081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1be3d952-63bf-47b5-a542-7151d77d4c74 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:52.704412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1be3d952-63bf-47b5-a542-7151d77d4c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.804725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:52.826329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1369/2760] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:52.841721 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:52.843967 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:52.934402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03b5f2-84e2-490a-b156-e38c1170a6fd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:52.938715 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:52.939484 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:52.939932 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:52.940584 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:52.953409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:52.955066 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:52.969811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1392/2761] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:53.952959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:53.953424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:53.953723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:53.988041 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] MFA Rules not processed for user `b8dae8d8471349468e88401bc80d1aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:53.989909 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:54.103231 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1370/2762] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:54.107365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.131413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34aa16-e52b-4c32-9201-06efe9b82a47 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.137264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.138061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.138490 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.138918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.140101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.141997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.173199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1393/2763] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:47:54 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:54.177604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.189856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19295f2-4916-450b-9006-c17eb8d5d778 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.282284 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.282964 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.283250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.284439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.285217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.288457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.343088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.346312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1371/2764] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:47:54 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:47:54.367335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c3357-f310-4539-a9d8-70bc737f80e3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.372672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.373298 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.373578 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.373848 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.374493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.386073 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.414021 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1394/2765] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:54.418417 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.431683 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ad6d-68c2-42b8-8b8d-e838848bd354 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.437074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.437791 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.438074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.438398 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] PATH_INFO: `/v3/projects/4ee50db674b941b4bc7309482c63150c/users/a38d659960bd40788eaf5b69f8fe1bcc/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.463519 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee50db674b941b4bc7309482c63150c, user_id=a38d659960bd40788eaf5b69f8fe1bcc, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.466314 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.480442 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1372/2766] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:54 2022] PUT /identity/v3/projects/4ee50db674b941b4bc7309482c63150c/users/a38d659960bd40788eaf5b69f8fe1bcc/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:54.484568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.495160 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ada2-e2f7-49fb-a098-57e16d230eeb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.570873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.571864 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.572230 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.572503 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.573162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.575140 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86a57-1989-4e73-865b-ef0835e802e4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.587706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1395/2767] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:47:54.591968 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:54.604481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745b939-26ba-4b6f-b921-ee655a252b82 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:54.610011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:54.610785 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:54.611200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:54.611577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] PATH_INFO: `/v3/projects/4ee50db674b941b4bc7309482c63150c/users/a38d659960bd40788eaf5b69f8fe1bcc/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:54.613689 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee50db674b941b4bc7309482c63150c, user_id=a38d659960bd40788eaf5b69f8fe1bcc, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:54.617022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a0c93-755f-4d77-a869-ee3c1dcb0812 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:54.636981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1373/2768] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:47:54 2022] PUT /identity/v3/projects/4ee50db674b941b4bc7309482c63150c/users/a38d659960bd40788eaf5b69f8fe1bcc/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:55.330492 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:55.331395 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:55.331682 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:55.384331 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] MFA Rules not processed for user `a38d659960bd40788eaf5b69f8fe1bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:55.385664 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:55.461945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:55.505577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1396/2769] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:55.517682 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:55.518545 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:55.519011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:55.550137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] MFA Rules not processed for user `b8dae8d8471349468e88401bc80d1aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:55.552642 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:55.592597 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:55.636432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1374/2770] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:47:55.652639 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:55.654035 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:55.655659 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:55.656263 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:55.733807 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948a0c-1010-4e6a-ac36-8c9ff89a181a None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:55.738102 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:55.738601 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:55.738882 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:55.739215 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:55.741089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:55.767472 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f276793-5d09-48d7-b80d-8ded75af3bd4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:55.775211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92d15db5127347b8b25cdf41abb2ab07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:55.775983 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:55.776388 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:55.776670 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:55.786845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:55.788651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:55.799561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1397/2771] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:55.820531 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:55.822188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:55.832438 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1375/2772] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:47:56.131012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:56.202587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca495cb5-bec3-4abd-a64c-01b1d71f5acd service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:56.207773 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:56.208455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:56.208739 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:56.209014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:56.211297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:56.221776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:56.223201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31392-aa71-42ca-a478-607a15d7c5cd service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:56.231366 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1398/2773] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:58.022895 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:58.024380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:58.089153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b5cdd-b90d-4307-9237-748584cd1fb3 service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:58.093678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:58.094308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:58.094584 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:58.094854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] PATH_INFO: `/v3/users/5cd6d2f32e6244c8952af7e96ab15900` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:58.095957 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd6d2f32e6244c8952af7e96ab15900)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:58.097896 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:58.142347 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:58.153740 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd6d2f32e6244c8952af7e96ab15900'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.155653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd6d2f32e6244c8952af7e96ab15900'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.164539 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd6d2f32e6244c8952af7e96ab15900'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.172253 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd6d2f32e6244c8952af7e96ab15900'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.172898 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd6d2f32e6244c8952af7e96ab15900'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.191149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1376/2774] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:58 2022] DELETE /identity/v3/users/5cd6d2f32e6244c8952af7e96ab15900 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:58.196072 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:58.196556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:58.196656 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:58.217000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:47:58.218196 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:58.294477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1399/2775] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:47:58.304986 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:58.307686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:58.371559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe7147-ff1a-4704-8fca-ae53835699b9 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:58.375947 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:58.376667 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:58.377010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:58.377340 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:58.387412 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:58.388940 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:58.399045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1377/2776] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:47:58.693328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:58.695348 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:58.711766 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115bca5-c449-4aae-80cb-c77a3a0f121f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:58.720899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:58.720899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:58.720899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:58.720899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] PATH_INFO: `/v3/projects/253c32c647f740b582ceb067f12006ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:58.721364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253c32c647f740b582ceb067f12006ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:58.723161 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:58.726075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:58.787885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253c32c647f740b582ceb067f12006ee', 'request_id': 'req-60177e61-410a-4423-96c8-cef5d4d45149'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.794120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253c32c647f740b582ceb067f12006ee', 'request_id': 'req-60177e61-410a-4423-96c8-cef5d4d45149'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.802266 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253c32c647f740b582ceb067f12006ee', 'request_id': 'req-60177e61-410a-4423-96c8-cef5d4d45149'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.816074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] The token cache is being invalidate because project 253c32c647f740b582ceb067f12006ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:58.816483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.817187 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.818729 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1400/2777] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:58 2022] DELETE /identity/v3/projects/253c32c647f740b582ceb067f12006ee => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:47:58.823348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:58.835504 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c8de-729a-4316-b88e-f129f67f1fae service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:58.911582 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:58.912265 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:58.912600 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:58.913451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] PATH_INFO: `/v3/users/431fc9b85dce41d98896821415f99d8b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:58.915024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=431fc9b85dce41d98896821415f99d8b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:58.917945 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:58.991723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431fc9b85dce41d98896821415f99d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:58.992635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431fc9b85dce41d98896821415f99d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.007148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431fc9b85dce41d98896821415f99d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.010166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:47:59.025524 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431fc9b85dce41d98896821415f99d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.026264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431fc9b85dce41d98896821415f99d8b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.045499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1378/2778] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:58 2022] DELETE /identity/v3/users/431fc9b85dce41d98896821415f99d8b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:59.801883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:59.803872 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:59.821513 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177e61-410a-4423-96c8-cef5d4d45149 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:47:59.882840 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:47:59.883728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:47:59.884097 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:47:59.884335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] PATH_INFO: `/v3/projects/a544d31bb6d8467a96e007e8385292df` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:47:59.885514 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a544d31bb6d8467a96e007e8385292df)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:47:59.887406 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:47:59.933326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a544d31bb6d8467a96e007e8385292df', 'request_id': 'req-d800e560-59a5-4136-ab3f-fa37668ae9cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.939595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a544d31bb6d8467a96e007e8385292df', 'request_id': 'req-d800e560-59a5-4136-ab3f-fa37668ae9cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.946433 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a544d31bb6d8467a96e007e8385292df', 'request_id': 'req-d800e560-59a5-4136-ab3f-fa37668ae9cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.959380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] The token cache is being invalidate because project a544d31bb6d8467a96e007e8385292df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:47:59.959695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.960367 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:47:59.961844 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1401/2779] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:47:59 2022] DELETE /identity/v3/projects/a544d31bb6d8467a96e007e8385292df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:47:59.965856 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:47:59.967299 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:47:59.986166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17befeb-e8e6-4501-89f5-d603c9587c3d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.048399 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.049112 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.049462 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.049854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] PATH_INFO: `/v3/users/76c3cffbea21469794a2cd3350abb1d4` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.050999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c3cffbea21469794a2cd3350abb1d4)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.053223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.113869 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c3cffbea21469794a2cd3350abb1d4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.114782 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c3cffbea21469794a2cd3350abb1d4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.125147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c3cffbea21469794a2cd3350abb1d4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.136781 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c3cffbea21469794a2cd3350abb1d4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.137509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-68df6ee7-a1bf-4fcf-aa73-531862d0cbb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c3cffbea21469794a2cd3350abb1d4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.157915 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1379/2780] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:47:59 2022] DELETE /identity/v3/users/76c3cffbea21469794a2cd3350abb1d4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:00.464946 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:00.466419 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:00.485365 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800e560-59a5-4136-ab3f-fa37668ae9cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.505478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:00.546064 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.546819 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.547164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.547439 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] PATH_INFO: `/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.548568 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ef54d1a3dd40a9b3d12b2e108d3cfa)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.550447 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.598940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ef54d1a3dd40a9b3d12b2e108d3cfa', 'request_id': 'req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.605449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ef54d1a3dd40a9b3d12b2e108d3cfa', 'request_id': 'req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.611561 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ef54d1a3dd40a9b3d12b2e108d3cfa', 'request_id': 'req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.624722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] The token cache is being invalidate because project d4ef54d1a3dd40a9b3d12b2e108d3cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:00.625017 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.625641 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bd3e6daa-9e80-4b30-aabf-51e70074b2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:00.627144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1402/2781] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:00 2022] DELETE /identity/v3/projects/d4ef54d1a3dd40a9b3d12b2e108d3cfa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:00.633012 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.633557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.633845 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.653784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:00.655013 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:00.707662 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:00.731885 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1380/2782] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:00.740003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.740339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.740620 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.761560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:00.762842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:00.770919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1403/2783] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:00.775826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:00.785506 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8ae7d-cd2f-43c3-a452-70bcc838808e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.790626 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.791221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.791494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.791761 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.792432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:48:00.792729 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.794306 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.808097 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1381/2784] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:48:00.810628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:00.820074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794651-7698-4743-b772-7f7c5fb8870a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.824873 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.825475 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.825803 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.826075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.826753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.828696 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.856737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1404/2785] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:48:00.860924 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:00.871329 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b5d3-218a-4814-81c9-af03accce835 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.930627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.931223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.931497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.931763 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.932397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.934352 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.955010 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1382/2786] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:00 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:00.959294 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:00.970078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f30f2-7ca3-4559-af62-de84a4a9851a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:00.974621 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:00.975257 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:00.975541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:00.975815 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:00.976554 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:00.978142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:00.987745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1405/2787] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:00.991628 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.001244 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9702-db95-434a-a0d3-95d4f19cb748 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.005843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.006428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.007237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.007502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.008153 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.009975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fa4b-c2c3-470f-917b-bb7a4b31e5ca admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.020283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1383/2788] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:01.024356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.034050 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9500-460c-4940-acab-d4be32beda44 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.039142 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.039778 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.040078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.040360 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] PATH_INFO: `/v3/projects/371869de98db44a4a71e609601776e58/users/19060275569e4086966e2be65bea0f4c/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.055071 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371869de98db44a4a71e609601776e58, user_id=19060275569e4086966e2be65bea0f4c, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.057790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.070245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1406/2789] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:01 2022] PUT /identity/v3/projects/371869de98db44a4a71e609601776e58/users/19060275569e4086966e2be65bea0f4c/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:01.081339 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.081837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.081939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.109477 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] MFA Rules not processed for user `19060275569e4086966e2be65bea0f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:01.110713 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:01.174959 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1384/2790] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:01.180385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.236774 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:01.255090 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527438c-bf06-443a-b95a-00a975cad544 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.262831 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.263440 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.263719 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.264008 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.268502 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.270975 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.309868 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1407/2791] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:01 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:48:01.314048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.326360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4223-dbf0-43b0-a698-605a5a0341f3 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.371286 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:01.384656 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.385272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.385548 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.385891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.386424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.388383 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.411639 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1385/2792] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:01 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:48:01.416392 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.427449 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e419f-ba24-454d-bfbe-91921af1a04d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.432264 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.432941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.433291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.433634 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.434372 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.436022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.447105 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1408/2793] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:01.451345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.462276 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9202ed-cac0-4655-9ec2-09a4b9b7e3ec admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.467243 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.468494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.468784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.469060 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] PATH_INFO: `/v3/projects/9420419f0a00452bb3376253e782b347/users/abed946359f147d0986c6d1da674cd32/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.484632 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9420419f0a00452bb3376253e782b347, user_id=abed946359f147d0986c6d1da674cd32, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.487272 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.500241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1386/2794] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:01 2022] PUT /identity/v3/projects/9420419f0a00452bb3376253e782b347/users/abed946359f147d0986c6d1da674cd32/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:01.504351 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.515580 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5833e-57b4-4ad3-93ea-14518c61efb7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.575936 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.576577 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.576855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.577148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.577777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.579350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19457d6c-1b8a-4ee5-8d4b-e58c19b516bf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.589920 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1409/2795] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:48:01.593967 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.604649 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e2cc3-6f34-4332-872f-5b04b3c77c8c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.609147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.609783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.610056 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.610325 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] PATH_INFO: `/v3/projects/9420419f0a00452bb3376253e782b347/users/abed946359f147d0986c6d1da674cd32/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.612233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9420419f0a00452bb3376253e782b347, user_id=abed946359f147d0986c6d1da674cd32, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.614810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.624690 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1387/2796] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:01 2022] PUT /identity/v3/projects/9420419f0a00452bb3376253e782b347/users/abed946359f147d0986c6d1da674cd32/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:01.689413 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.689695 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.689996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.719120 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] MFA Rules not processed for user `abed946359f147d0986c6d1da674cd32`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:01.720640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:01.793034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1410/2797] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:01.804499 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:01.806194 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:01.864297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654d78c-fcf1-446c-8aec-08a71c4f7a03 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:01.868047 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:01.868914 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:01.869229 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:01.869660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:01.879024 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:01.880599 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:01.892496 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1388/2798] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:48:01.997837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:02.008144 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f163f80-0ba3-48c5-86bd-282373546d53 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:02.011837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:02.012726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:02.012726 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:02.012988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:02.054892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:02.074087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:02.075517 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5aa1cf-329b-4cbc-a94a-d670fa97d35c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:02.084603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1411/2799] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:04.670288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:04.751610 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77439d15-f3a8-4fd9-8076-d94ef86689bc service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:04.756283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:04.757508 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:04.757903 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:04.758233 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] PATH_INFO: `/v3/users/19060275569e4086966e2be65bea0f4c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:04.759679 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19060275569e4086966e2be65bea0f4c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:04.763415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:04.810722 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:04.812586 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19060275569e4086966e2be65bea0f4c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:04.813498 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19060275569e4086966e2be65bea0f4c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:04.822081 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19060275569e4086966e2be65bea0f4c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:04.829516 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19060275569e4086966e2be65bea0f4c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:04.830175 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19060275569e4086966e2be65bea0f4c'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:04.854913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1389/2800] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:04 2022] DELETE /identity/v3/users/19060275569e4086966e2be65bea0f4c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:04.859917 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:04.860431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:04.860573 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:04.879002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:04.880435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:04.938272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1412/2801] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:04.949242 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:04.951127 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:05.020666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf5a-24d6-462b-b4f3-8d116f2aa1a0 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:05.025465 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:05.026217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:05.026497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:05.026880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:05.037322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:05.038824 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:05.049693 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1390/2802] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:05.373222 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:05.374817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:05.388688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c7ee9-33d0-4851-bf4f-437050c9543b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:05.395211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:05.395856 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:05.396172 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:05.396603 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] PATH_INFO: `/v3/projects/371869de98db44a4a71e609601776e58` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:05.397916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371869de98db44a4a71e609601776e58)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:05.399939 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:05.447876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371869de98db44a4a71e609601776e58', 'request_id': 'req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.453585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371869de98db44a4a71e609601776e58', 'request_id': 'req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.459753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371869de98db44a4a71e609601776e58', 'request_id': 'req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.474250 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] The token cache is being invalidate because project 371869de98db44a4a71e609601776e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:05.474762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.475915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.477427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1413/2803] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:05 2022] DELETE /identity/v3/projects/371869de98db44a4a71e609601776e58 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:05.481533 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:05.491697 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d127bc-df27-44c8-a7bc-32d949634fca service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:05.555147 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:05.556006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:05.556378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:05.556800 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] PATH_INFO: `/v3/users/abed946359f147d0986c6d1da674cd32` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:05.558180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abed946359f147d0986c6d1da674cd32)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:05.560232 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:05.618415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abed946359f147d0986c6d1da674cd32'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.619001 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abed946359f147d0986c6d1da674cd32'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.628116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abed946359f147d0986c6d1da674cd32'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.635876 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abed946359f147d0986c6d1da674cd32'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.636668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-a1c0c8a4-e507-4863-87e9-a13b917ac221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abed946359f147d0986c6d1da674cd32'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:05.641381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:05.656435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1391/2804] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:05 2022] DELETE /identity/v3/users/abed946359f147d0986c6d1da674cd32 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:05.934849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:05.936499 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:05.950364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0557-efbd-4dc6-9eb6-b2ccfc6b5fa9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.010371 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.011000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.011278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.011752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] PATH_INFO: `/v3/projects/9420419f0a00452bb3376253e782b347` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.012668 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9420419f0a00452bb3376253e782b347)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.014558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.022905 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:06.062590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9420419f0a00452bb3376253e782b347', 'request_id': 'req-52e82417-d59c-44f0-98c1-ea27d70f39e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:06.067987 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9420419f0a00452bb3376253e782b347', 'request_id': 'req-52e82417-d59c-44f0-98c1-ea27d70f39e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:06.074059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9420419f0a00452bb3376253e782b347', 'request_id': 'req-52e82417-d59c-44f0-98c1-ea27d70f39e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:06.087768 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] The token cache is being invalidate because project 9420419f0a00452bb3376253e782b347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:06.088079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:06.088690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-52e82417-d59c-44f0-98c1-ea27d70f39e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:06.090176 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1414/2805] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:05 2022] DELETE /identity/v3/projects/9420419f0a00452bb3376253e782b347 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:06.095928 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.096461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.096571 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.116121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:06.117316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:06.174984 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1392/2806] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:06.182885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.183171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.183442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.203680 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:06.204595 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:06.213080 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1415/2807] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:06.217439 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.226970 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c2f8-4761-4eee-86f0-7af700164c57 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.231479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.232095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.232375 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.232641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.233273 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:48:06.233567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.235176 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.247330 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1393/2808] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:48:06.251756 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.262059 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919dee1-27e8-4628-81b3-3f93cb249f79 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.266962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.267747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.268456 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.268742 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.269532 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.271487 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.308985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1416/2809] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:06 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:06.313250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.328180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4405aa-aad9-485c-8317-807573c35111 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.425401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.425931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.426209 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.426473 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.427089 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.429042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.449865 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1394/2810] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:06 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:06.454162 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.464860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf515-96a8-4c25-b750-6524f3dd18ad admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.469445 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.470039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.470318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.470587 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.471221 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.472838 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.482588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1417/2811] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:06.486391 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.496149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5931315-d3ed-4fec-9a2d-e41f9fba8dc7 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.500594 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.501172 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.501557 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.501826 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.502456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.504019 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb5043-4ea8-4272-9ff1-3d963f58568c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.515170 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1395/2812] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:06.519203 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.529651 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3084-ead8-40ca-b3f0-6476ba0cc1d4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.534212 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.534854 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.535131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.535403 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] PATH_INFO: `/v3/projects/df0efbe20c194bb884d00f076acb09eb/users/a1d654c37e9f44afbe19c6fcafc63192/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.549455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0efbe20c194bb884d00f076acb09eb, user_id=a1d654c37e9f44afbe19c6fcafc63192, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.552087 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.565453 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1418/2813] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:06 2022] PUT /identity/v3/projects/df0efbe20c194bb884d00f076acb09eb/users/a1d654c37e9f44afbe19c6fcafc63192/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:06.575990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec663-00eb-4afa-b9ec-088a27b0d466 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.576302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec663-00eb-4afa-b9ec-088a27b0d466 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.576569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec663-00eb-4afa-b9ec-088a27b0d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.602686 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fd0ec663-00eb-4afa-b9ec-088a27b0d466 None None] MFA Rules not processed for user `a1d654c37e9f44afbe19c6fcafc63192`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:06.603874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fd0ec663-00eb-4afa-b9ec-088a27b0d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:06.642598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:06.667685 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1396/2814] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:06.679467 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:06.681117 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:06.743477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba82b5-ae75-4d42-8bbe-ad9c339089f1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:06.747124 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ee82cc4136a4b23aeaf4e115fe7bd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:06.747731 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:06.748013 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:06.748315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:06.757164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:06.758845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:06.767953 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1419/2815] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:07.473362 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd99-7735-4b24-98be-9066626c2033 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:07.473999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd99-7735-4b24-98be-9066626c2033 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:07.473999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdd99-7735-4b24-98be-9066626c2033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:07.495122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a86fdd99-7735-4b24-98be-9066626c2033 None None] MFA Rules not processed for user `855304c2eae64820bd69c2d1038ea61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:07.496469 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a86fdd99-7735-4b24-98be-9066626c2033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:07.559453 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1397/2816] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:09.219960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:09.221613 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:09.274489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:09.302385 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589658fa-d888-4033-b87e-ea1d5cfe8d89 service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:09.306435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:09.307335 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:09.307704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:09.308100 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:09.310280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:09.396199 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:09.398416 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:09.408609 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1420/2817] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:17.551481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=34 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:19.403962 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=34 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:24.989990 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:24.990487 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:24.990680 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:25.022648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:25.023842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:25.104421 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1398/2818] 10.222.0.73 () {58 vars in 1009 bytes} [Thu Aug 18 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:25.151891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:25.153356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:25.265640 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0b6b-cd21-46ef-b116-a317bf2157c1 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:25.270745 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:25.271339 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:25.271612 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:25.271877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:25.280541 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:25.282107 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:25.291035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1421/2819] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:48:29.392889 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:29.394365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:29.519275 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23a8fe-3efd-4603-be3f-a050abf01c45 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:29.525161 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:29.525806 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:29.526092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:29.526360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] PATH_INFO: `/v3/users/b8dae8d8471349468e88401bc80d1aa4` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:29.527494 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8dae8d8471349468e88401bc80d1aa4)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:29.529446 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:29.571957 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:29.582972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c8637-a64c-41b6-b5d3-cd7d95461afe service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:29.588972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:29.589642 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:29.590158 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:29.590478 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] PATH_INFO: `/v3/users/a1d654c37e9f44afbe19c6fcafc63192` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:29.594004 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d654c37e9f44afbe19c6fcafc63192)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:29.595935 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:29.609369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:29.612666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8dae8d8471349468e88401bc80d1aa4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.613786 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8dae8d8471349468e88401bc80d1aa4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.624798 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8dae8d8471349468e88401bc80d1aa4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.639264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8dae8d8471349468e88401bc80d1aa4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.640045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7505a253-2c9b-4d75-9fc4-8051f40929b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8dae8d8471349468e88401bc80d1aa4'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.663316 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d654c37e9f44afbe19c6fcafc63192'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.663979 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d654c37e9f44afbe19c6fcafc63192'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.668560 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1399/2820] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:29 2022] DELETE /identity/v3/users/b8dae8d8471349468e88401bc80d1aa4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:29.688077 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d654c37e9f44afbe19c6fcafc63192'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.689156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d654c37e9f44afbe19c6fcafc63192'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.701706 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d654c37e9f44afbe19c6fcafc63192'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:29.730567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1422/2821] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:29 2022] DELETE /identity/v3/users/a1d654c37e9f44afbe19c6fcafc63192 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:29.736515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:29.736802 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:29.737237 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:29.779857 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:29.782196 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:29.893565 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1400/2822] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:29.901256 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:29.909320 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:29.915678 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:29.917381 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:29.952092 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f455-8c4f-44b3-8fb0-ad7530dd33e5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:29.963459 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:29.964311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:29.964654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:29.965350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] PATH_INFO: `/v3/projects/73da19bd6dd34447bb7a8175438d58cc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:29.966782 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=73da19bd6dd34447bb7a8175438d58cc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:29.970104 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:30.001378 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:30.020014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc494c8-d94e-4f86-841b-507d0d51bca5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:30.024921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:30.025858 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:30.026577 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:30.027036 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:30.041190 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:30.045199 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:30.051909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73da19bd6dd34447bb7a8175438d58cc', 'request_id': 'req-7e300f0e-55a9-4fc8-9aba-d855359adbef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.058777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73da19bd6dd34447bb7a8175438d58cc', 'request_id': 'req-7e300f0e-55a9-4fc8-9aba-d855359adbef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.066286 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73da19bd6dd34447bb7a8175438d58cc', 'request_id': 'req-7e300f0e-55a9-4fc8-9aba-d855359adbef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.068472 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1401/2823] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:30.098062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] The token cache is being invalidate because project 73da19bd6dd34447bb7a8175438d58cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:30.098442 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.099183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.104074 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1423/2824] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:29 2022] DELETE /identity/v3/projects/73da19bd6dd34447bb7a8175438d58cc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:30.105660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:30.119392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774db0-3a4c-4884-a437-c729a7f68c58 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:30.200520 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:30.218262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:30.219405 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:30.220734 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:30.221361 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] PATH_INFO: `/v3/users/a38d659960bd40788eaf5b69f8fe1bcc` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:30.222880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38d659960bd40788eaf5b69f8fe1bcc)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:30.224852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:30.329193 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38d659960bd40788eaf5b69f8fe1bcc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.330461 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38d659960bd40788eaf5b69f8fe1bcc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.344852 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38d659960bd40788eaf5b69f8fe1bcc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.353452 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38d659960bd40788eaf5b69f8fe1bcc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.354292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38d659960bd40788eaf5b69f8fe1bcc'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.379808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1402/2825] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:30 2022] DELETE /identity/v3/users/a38d659960bd40788eaf5b69f8fe1bcc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:30.423498 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:30.424841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:30.441291 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300f0e-55a9-4fc8-9aba-d855359adbef admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:30.542582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:30.543397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:30.543817 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:30.544198 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] PATH_INFO: `/v3/projects/df0efbe20c194bb884d00f076acb09eb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:30.545474 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0efbe20c194bb884d00f076acb09eb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:30.547496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:30.605654 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0efbe20c194bb884d00f076acb09eb', 'request_id': 'req-ec355304-6725-441e-98e1-c087c9eaf9a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.610171 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0efbe20c194bb884d00f076acb09eb', 'request_id': 'req-ec355304-6725-441e-98e1-c087c9eaf9a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.616960 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0efbe20c194bb884d00f076acb09eb', 'request_id': 'req-ec355304-6725-441e-98e1-c087c9eaf9a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.637697 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] The token cache is being invalidate because project df0efbe20c194bb884d00f076acb09eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:30.637991 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.638660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ec355304-6725-441e-98e1-c087c9eaf9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.647657 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:30.649290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:30.656135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1424/2826] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:30 2022] DELETE /identity/v3/projects/df0efbe20c194bb884d00f076acb09eb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:30.669166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8ae86-7bb5-4699-b810-512913768d8c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:30.746369 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:30.747184 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:30.747478 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:30.747735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] PATH_INFO: `/v3/projects/4ee50db674b941b4bc7309482c63150c` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:30.749074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee50db674b941b4bc7309482c63150c)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:30.751202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:30.820764 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee50db674b941b4bc7309482c63150c', 'request_id': 'req-130a8008-84af-4065-a1f8-ffc74e427ef9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.828048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee50db674b941b4bc7309482c63150c', 'request_id': 'req-130a8008-84af-4065-a1f8-ffc74e427ef9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.866929 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee50db674b941b4bc7309482c63150c', 'request_id': 'req-130a8008-84af-4065-a1f8-ffc74e427ef9'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.886246 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] The token cache is being invalidate because project 4ee50db674b941b4bc7309482c63150c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:30.886663 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.887444 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-130a8008-84af-4065-a1f8-ffc74e427ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:30.889393 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1403/2827] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:30 2022] DELETE /identity/v3/projects/4ee50db674b941b4bc7309482c63150c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:30.895489 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430bff-27df-4008-895a-d922470636f4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:30.895893 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430bff-27df-4008-895a-d922470636f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:30.896330 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430bff-27df-4008-895a-d922470636f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:30.959454 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad430bff-27df-4008-895a-d922470636f4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:30.960909 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad430bff-27df-4008-895a-d922470636f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:30.968428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:31.036012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1425/2828] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:31.045390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.045816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.046173 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.063380 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:31.070355 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:31.071837 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:31.082406 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1404/2829] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:31.087709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430bff-27df-4008-895a-d922470636f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.098167 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430bff-27df-4008-895a-d922470636f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.103173 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.104358 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.104798 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.105079 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.105753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:48:31.106061 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.107753 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.125709 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1426/2830] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:48:31.127250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.137780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc37c6e-ac35-4b82-af6f-6a2ba315e74f None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.142974 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.143609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.143891 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.144235 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.144939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.146923 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.181241 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1405/2831] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:31.185292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.196039 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017dd0-e108-409d-9748-2352089ee2f2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.279229 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.280177 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.280619 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.280985 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.281515 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.283427 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.307691 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1427/2832] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:31.311456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.324612 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6c79d-f280-43d2-9e90-8a880c33160c admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.329587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.330250 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.330537 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.330810 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.331456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.333159 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.344264 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1406/2833] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:31.348943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.361005 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6026a-918f-4979-b4fa-9304aec66b05 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.368857 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.369899 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.370411 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.370754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.371465 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.373159 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf2f6c-5e5a-4c9c-884a-b017400b9e03 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.392114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1428/2834] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:31.396418 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.408148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5656c4-2241-4bda-b01e-14a9fd005633 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.414045 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.414765 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.415023 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.415332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] PATH_INFO: `/v3/projects/bfee1a393b5347e79d28e03da90602f8/users/18543df692a7442390fb9c579739dcd0/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.431390 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfee1a393b5347e79d28e03da90602f8, user_id=18543df692a7442390fb9c579739dcd0, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.434108 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.452137 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1407/2835] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:31 2022] PUT /identity/v3/projects/bfee1a393b5347e79d28e03da90602f8/users/18543df692a7442390fb9c579739dcd0/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:31.463629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.463919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.464227 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.492892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] MFA Rules not processed for user `18543df692a7442390fb9c579739dcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:31.494115 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:31.567246 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1429/2836] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:48:31.573710 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.650323 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fd736-288b-41de-b984-47cd0198df88 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.655897 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.656609 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.656961 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.657304 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.658008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.660008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.689546 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1408/2837] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:31.693393 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.706575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a9f-3601-463a-bc74-dc0d52a01c84 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.711094 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:31.786364 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.787658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.787941 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.788249 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.788875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.790891 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.819488 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1430/2838] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:31 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:31.820749 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.832502 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff980-d7dc-42df-8eda-cf432332de8b admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.837303 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.837934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.838396 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.838675 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.839555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.841203 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.856344 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1409/2839] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:31.857528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.876516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118283c5-b46e-46fa-9382-69533e229b3a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:31.881265 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:31.881927 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:31.882205 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:31.882477 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] PATH_INFO: `/v3/projects/359f72de24de49b781526258f49c4f14/users/68f5e5b50f6142a7b6eb579a4ecbc55b/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:31.903767 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359f72de24de49b781526258f49c4f14, user_id=68f5e5b50f6142a7b6eb579a4ecbc55b, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:31.906448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:31.921307 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1431/2840] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:31 2022] PUT /identity/v3/projects/359f72de24de49b781526258f49c4f14/users/68f5e5b50f6142a7b6eb579a4ecbc55b/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:31.925332 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:31.937191 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2d5d3-0011-44af-9763-dc3ab75141ed admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:32.005052 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:32.005668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:32.005948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:32.006217 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:32.006875 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:32.008627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854f40f-1ea4-4ec2-a3d2-4bfe85d8eb1c admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:32.023008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1410/2841] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:32.027095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:32.038119 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e515-89a0-4f02-9216-052abac22467 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:32.043516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:32.044347 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:32.044754 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:32.045129 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] PATH_INFO: `/v3/projects/359f72de24de49b781526258f49c4f14/users/68f5e5b50f6142a7b6eb579a4ecbc55b/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:32.047353 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=359f72de24de49b781526258f49c4f14, user_id=68f5e5b50f6142a7b6eb579a4ecbc55b, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:32.050297 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:32.068617 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1432/2842] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:32 2022] PUT /identity/v3/projects/359f72de24de49b781526258f49c4f14/users/68f5e5b50f6142a7b6eb579a4ecbc55b/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:32.078823 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:32.079111 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:32.079397 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:32.112635 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:32.118583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] MFA Rules not processed for user `68f5e5b50f6142a7b6eb579a4ecbc55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:32.121371 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:32.200311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1411/2843] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:32.212424 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:32.215130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:32.295032 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333509b1-eeb3-4acd-b3d1-5fc64168455b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:32.302426 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:32.303380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:32.303806 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:32.304278 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:32.376010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:32.377737 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79791-3a27-4fa7-a298-a18545fa3d2f service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:32.389989 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1433/2844] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:48:35.037064 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:35.128116 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c5a66-2915-4031-901f-b76a78bf68a5 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:35.132801 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:35.133435 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:35.133773 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:35.134309 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] PATH_INFO: `/v3/users/18543df692a7442390fb9c579739dcd0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:35.135443 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18543df692a7442390fb9c579739dcd0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:35.137428 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:35.199118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18543df692a7442390fb9c579739dcd0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:35.199816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18543df692a7442390fb9c579739dcd0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:35.210604 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18543df692a7442390fb9c579739dcd0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:35.219886 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18543df692a7442390fb9c579739dcd0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:35.220745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18543df692a7442390fb9c579739dcd0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:35.242271 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1412/2845] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:35 2022] DELETE /identity/v3/users/18543df692a7442390fb9c579739dcd0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:35.247370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:35.248425 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:35.248527 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:35.270799 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:35.272006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:35.281723 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:35.341148 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1434/2846] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:35.356382 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:35.357995 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:35.402148 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:35.468726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962b16-f167-45e5-9609-54d19a8dcbdd admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:35.472497 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:35.475322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:35.475322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:35.475322 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:35.487874 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:35.489434 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:35.504240 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1413/2847] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:35.900884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:35.902884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:35.919057 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa530-2cdc-44cc-8931-6829b26ba42a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:35.927629 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:35.928535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:35.928839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:35.929190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] PATH_INFO: `/v3/projects/bfee1a393b5347e79d28e03da90602f8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:35.930885 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfee1a393b5347e79d28e03da90602f8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:35.933501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:36.011084 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfee1a393b5347e79d28e03da90602f8', 'request_id': 'req-041e1585-7662-4091-9854-a0435b4a69bd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.017397 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfee1a393b5347e79d28e03da90602f8', 'request_id': 'req-041e1585-7662-4091-9854-a0435b4a69bd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.024155 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfee1a393b5347e79d28e03da90602f8', 'request_id': 'req-041e1585-7662-4091-9854-a0435b4a69bd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.039853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] The token cache is being invalidate because project bfee1a393b5347e79d28e03da90602f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:36.040309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.040860 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.042479 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1435/2848] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:35 2022] DELETE /identity/v3/projects/bfee1a393b5347e79d28e03da90602f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:36.046669 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:36.058542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64371c-caf4-4171-8ded-bb3daf082d20 service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:36.126698 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:36.127795 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.128099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.128400 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] PATH_INFO: `/v3/users/68f5e5b50f6142a7b6eb579a4ecbc55b` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.129618 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f5e5b50f6142a7b6eb579a4ecbc55b)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:36.131527 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:36.193068 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f5e5b50f6142a7b6eb579a4ecbc55b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.193808 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f5e5b50f6142a7b6eb579a4ecbc55b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.204559 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f5e5b50f6142a7b6eb579a4ecbc55b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.215627 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f5e5b50f6142a7b6eb579a4ecbc55b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.216603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9999d365-fda4-4c95-9696-cb4209d73f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f5e5b50f6142a7b6eb579a4ecbc55b'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.240849 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1414/2849] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:36 2022] DELETE /identity/v3/users/68f5e5b50f6142a7b6eb579a4ecbc55b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:36.577481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:36.577481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:36.587175 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e1585-7662-4091-9854-a0435b4a69bd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:36.664379 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:36.665585 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.666054 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.666661 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] PATH_INFO: `/v3/projects/359f72de24de49b781526258f49c4f14` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.668043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=359f72de24de49b781526258f49c4f14)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:36.670055 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:36.711448 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:36.724952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359f72de24de49b781526258f49c4f14', 'request_id': 'req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.739143 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359f72de24de49b781526258f49c4f14', 'request_id': 'req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.746510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359f72de24de49b781526258f49c4f14', 'request_id': 'req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.761915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] The token cache is being invalidate because project 359f72de24de49b781526258f49c4f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:36.762460 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.763267 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a4ce7ee-c2a7-46c9-bb10-eebfc41e4edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:36.765887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1436/2850] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:36 2022] DELETE /identity/v3/projects/359f72de24de49b781526258f49c4f14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:36.771141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483706-db3a-4d25-930c-df0596786af1 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.771513 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483706-db3a-4d25-930c-df0596786af1 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.771796 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483706-db3a-4d25-930c-df0596786af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.795745 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-17483706-db3a-4d25-930c-df0596786af1 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:36.797288 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-17483706-db3a-4d25-930c-df0596786af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:36.838812 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:36.880316 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1415/2851] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:36.883423 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.883762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.884326 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.906725 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:36.908211 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:36.917223 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1437/2852] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:36.921387 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483706-db3a-4d25-930c-df0596786af1 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:36.932716 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483706-db3a-4d25-930c-df0596786af1 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:36.937650 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:36.938336 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.938708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.939092 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.939894 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:48:36.940348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:36.942106 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:36.955775 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1416/2853] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:48:36.960213 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:36.971038 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0860f0-6cfe-4fbb-829f-abe6d018dbb4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:36.976516 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:36.977114 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:36.977420 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:36.978349 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:36.979284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:36.981218 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.013355 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1438/2854] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:36 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:37.018510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:37.029691 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66191f54-0673-4583-a6b6-c72d2f4e03eb admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:37.098521 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:37.099188 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.099297 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.099595 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.100283 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:37.102255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.127451 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1417/2855] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:37 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:37.131333 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:37.143968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad72c6-8d2b-4529-adf5-73d6b6e2de9f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:37.151273 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:37.151938 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.152404 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.152807 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.153724 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:37.155833 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.172786 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1439/2856] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:37.174911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:37.187981 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110a66b-de0b-4cc7-b5e7-cab9f9778e67 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:37.192757 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:37.193360 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.193634 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.193904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.194543 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:37.196238 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e22dd1-3ba6-4dea-9c77-16b7ec19858d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.208482 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1418/2857] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:37.213315 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:37.224560 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962fd-631a-46da-ae69-60eee58b912c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:37.230181 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:37.230865 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.231147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.231431 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] PATH_INFO: `/v3/projects/c5a302d1d52a4843ad3b6edf8b2602a3/users/757158927cdd4b849cefc945a3a1724f/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.248075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a302d1d52a4843ad3b6edf8b2602a3, user_id=757158927cdd4b849cefc945a3a1724f, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:37.250781 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.267435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1440/2858] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:37 2022] PUT /identity/v3/projects/c5a302d1d52a4843ad3b6edf8b2602a3/users/757158927cdd4b849cefc945a3a1724f/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:37.278708 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a7a2-16b5-43a2-b971-e2868395c089 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.279368 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a7a2-16b5-43a2-b971-e2868395c089 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.279668 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a7a2-16b5-43a2-b971-e2868395c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.318150 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-2aa6a7a2-16b5-43a2-b971-e2868395c089 None None] MFA Rules not processed for user `757158927cdd4b849cefc945a3a1724f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:37.319364 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2aa6a7a2-16b5-43a2-b971-e2868395c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:37.402095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1419/2859] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:37.413988 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:37.415816 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:37.497973 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2f214-49b7-45eb-be8f-96ee01a733f5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:37.501776 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:37.502402 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:37.502681 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:37.502951 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:37.513913 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:37.515622 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:37.528686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1441/2860] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:40.654456 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:40.654931 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:40.655039 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:40.683008 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] MFA Rules not processed for user `77b45502aefb42cbaaa7cc4d3f63f406`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:40.684207 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:40.705658 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:40.742022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1420/2861] 10.222.0.73 () {58 vars in 967 bytes} [Thu Aug 18 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:40.754777 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:40.756247 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:40.827481 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4fa9-3daa-423c-bace-1ce75c20881a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:40.832847 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47af3f28f044f68a90e6a78ee3102a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:40.833455 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:40.833735 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:40.834006 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:40.834202 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:40.840190 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:40.842883 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:40.845089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e5b4-fdaa-413a-859f-c1640122ee7c service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:40.856700 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1442/2862] 10.222.0.73 () {60 vars in 1384 bytes} [Thu Aug 18 16:48:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:48:40.900517 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124c157-1008-457d-bf77-fe28f71656ff None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:40.905078 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:40.905736 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:40.906017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:40.906290 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] PATH_INFO: `/v3/users/757158927cdd4b849cefc945a3a1724f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:40.907424 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=757158927cdd4b849cefc945a3a1724f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:40.909410 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:40.959835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757158927cdd4b849cefc945a3a1724f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:40.960624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757158927cdd4b849cefc945a3a1724f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:40.969611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757158927cdd4b849cefc945a3a1724f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:40.977122 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757158927cdd4b849cefc945a3a1724f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:40.978337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757158927cdd4b849cefc945a3a1724f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:40.998936 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1421/2863] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:40 2022] DELETE /identity/v3/users/757158927cdd4b849cefc945a3a1724f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:41.003551 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.003837 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.004135 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.023835 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:41.025210 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:41.089875 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1443/2864] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:41.099892 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.101345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:41.161166 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883fd3-a24d-480d-9107-50b26a845a1a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.164726 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.165854 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.166130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.166401 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.173262 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:41.176450 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.179254 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6ea8-a327-4143-a366-9760f86a8273 service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.191913 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1422/2865] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:48:41.464183 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.466051 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:41.480660 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244af58-e68a-4f43-aea3-701046d7df05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.485149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.486435 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.486722 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.487002 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] PATH_INFO: `/v3/projects/c5a302d1d52a4843ad3b6edf8b2602a3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.488156 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a302d1d52a4843ad3b6edf8b2602a3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.490048 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.535686 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a302d1d52a4843ad3b6edf8b2602a3', 'request_id': 'req-1484d73a-2102-4828-ac03-760e089941d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:41.541684 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a302d1d52a4843ad3b6edf8b2602a3', 'request_id': 'req-1484d73a-2102-4828-ac03-760e089941d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:41.547904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a302d1d52a4843ad3b6edf8b2602a3', 'request_id': 'req-1484d73a-2102-4828-ac03-760e089941d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:41.559841 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] The token cache is being invalidate because project c5a302d1d52a4843ad3b6edf8b2602a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:41.560166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:41.560785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1484d73a-2102-4828-ac03-760e089941d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:41.562325 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1444/2866] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:41 2022] DELETE /identity/v3/projects/c5a302d1d52a4843ad3b6edf8b2602a3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:41.567337 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.567633 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.567904 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.586864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:41.588583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:41.645767 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1423/2867] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:41.654811 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.655089 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.655357 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.674842 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:41.676012 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:41.683615 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1445/2868] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:41.687784 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.697432 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce490f-f1eb-4432-aa3c-6a8cc62f214e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.701941 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.702555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.702841 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.703098 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] PATH_INFO: `/v3/domains` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.703725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:48:41.704022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.705620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.717430 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1424/2869] 10.222.0.73 () {58 vars in 1153 bytes} [Thu Aug 18 16:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:48:41.721644 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.731497 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830841db-0526-4504-a61e-0b9f163a25ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.736281 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.736876 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.737149 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.737415 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.738034 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.739887 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.767409 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1446/2870] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:41 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:48:41.771205 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.781564 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ab67-bb7a-4a65-9ab0-73e11e131121 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.836975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.838069 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.838342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.838608 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.839221 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.841158 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.861348 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1425/2871] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:41 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:41.865483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.875904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96d540-319a-4ecf-9346-441fee803d6b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.880571 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.881164 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.881441 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.881730 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.882342 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.883919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.894108 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1447/2872] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:41.898113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.908567 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868e8c4-d649-4e60-9a62-17dabb5c02b6 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.913156 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.913737 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.914014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.914285 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.914921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.916653 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e24550-6dd0-4cc6-804f-5b15a3e2dec8 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.926378 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1426/2873] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:41.930493 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:41.940308 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24bc5-7090-4034-948d-3e2964071244 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:41.944870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:41.945510 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:41.945790 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:41.946062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] PATH_INFO: `/v3/projects/1a191709839b43e9864c199fcbaae237/users/f468dd924c5242158e912e7511a467f0/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:41.960590 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a191709839b43e9864c199fcbaae237, user_id=f468dd924c5242158e912e7511a467f0, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:41.963845 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:41.976582 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1448/2874] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:41 2022] PUT /identity/v3/projects/1a191709839b43e9864c199fcbaae237/users/f468dd924c5242158e912e7511a467f0/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:42.040255 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.040538 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.040814 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.067911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] MFA Rules not processed for user `f468dd924c5242158e912e7511a467f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:42.069152 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:42.114939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:42.133566 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1427/2875] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:42.138897 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.156028 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:42.202518 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c3fa0-45d2-49d9-b4b2-cc2c54c96a3b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.207166 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.207762 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.208044 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.208346 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.208969 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.210884 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.237194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1449/2876] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:42.241445 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.252407 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db281a6-b3f9-4846-ad77-19f918c92183 None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.316121 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.316829 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.317113 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.317386 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.318014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.319948 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.343128 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1428/2877] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:42.347182 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.357658 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26e6a8-dd45-4b9d-99cd-11c282460fc8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.363018 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.363704 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.364049 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.364437 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.365195 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.366785 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.378997 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1450/2878] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:42.382999 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.394029 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01263b8c-048e-4208-b5e1-72ecc9fd2368 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.399099 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.399725 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.400088 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.400392 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.401027 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.402620 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4af838-3f39-4abd-8466-922bc8a50aa1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.415783 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1429/2879] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:42.417245 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.427496 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d728-cba1-4a19-873d-95b371ddc137 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.432676 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.433328 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.433606 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.433877 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] PATH_INFO: `/v3/projects/336ee6bb95354ba0a948ccb199394a30/users/b86222d84ee14dc3bbaa483c7ba6fe9f/roles/3524ec8100184d48956522845b1fbebe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.449653 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=336ee6bb95354ba0a948ccb199394a30, user_id=b86222d84ee14dc3bbaa483c7ba6fe9f, role_id=3524ec8100184d48956522845b1fbebe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.452276 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.465867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1451/2880] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:42 2022] PUT /identity/v3/projects/336ee6bb95354ba0a948ccb199394a30/users/b86222d84ee14dc3bbaa483c7ba6fe9f/roles/3524ec8100184d48956522845b1fbebe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:42.476425 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.477423 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.478542 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.510032 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.auth.core [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] MFA Rules not processed for user `b86222d84ee14dc3bbaa483c7ba6fe9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:42.511334 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:42.577003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1430/2881] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:42.581480 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.643280 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a81485-562f-46e4-9046-240e17cde5ac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.647944 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.648581 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.648874 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.649138 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.650363 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.652253 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.678734 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1452/2882] 10.222.0.73 () {60 vars in 1153 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:42.682794 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.693258 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7209e1a-08c7-4818-85e4-960a5179420e None None] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.750547 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:42.758003 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.758684 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.759583 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.759921 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.760641 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.762598 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.788022 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1431/2883] 10.222.0.73 () {60 vars in 1144 bytes} [Thu Aug 18 16:48:42 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:48:42.789231 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.799823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ee972-b811-4e56-956b-fa3b094a556f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.804663 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.805299 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.805690 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.805996 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.806972 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.808334 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.808939 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.811087 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:42.819705 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1453/2884] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:48:42.824318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.827404 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b077d-0014-440e-89f1-be8910786be1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.832828 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.833457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.833735 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.833908 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23a6ec-2216-43ff-bd33-9cb4d6886dd1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.834017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] PATH_INFO: `/v3/users/855304c2eae64820bd69c2d1038ea61a` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.835164 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] RBAC: Authorizing `identity:delete_user(user_id=855304c2eae64820bd69c2d1038ea61a)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.837705 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.839194 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.839823 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.840350 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.840470 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] PATH_INFO: `/v3/projects/b72c83a33a104bca9203117302816370/users/36c5d4eaa3644fd383db11e6a31bcac5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.854610 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72c83a33a104bca9203117302816370, user_id=36c5d4eaa3644fd383db11e6a31bcac5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:42.857462 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:42.871616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1454/2885] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:42 2022] PUT /identity/v3/projects/b72c83a33a104bca9203117302816370/users/36c5d4eaa3644fd383db11e6a31bcac5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:42.875550 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:42.891820 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855304c2eae64820bd69c2d1038ea61a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:42.892511 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855304c2eae64820bd69c2d1038ea61a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:42.893540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:42.900326 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855304c2eae64820bd69c2d1038ea61a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:42.907345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855304c2eae64820bd69c2d1038ea61a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:42.908011 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855304c2eae64820bd69c2d1038ea61a'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:42.925843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1432/2886] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:42 2022] DELETE /identity/v3/users/855304c2eae64820bd69c2d1038ea61a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:42.940292 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b6c7f-c77e-463d-b1a1-7441895700ad admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:42.996812 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:42.997457 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:42.997736 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:42.998000 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:42.998688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:43.000405 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a24e9d-03ef-494c-9d0a-4764e35a44ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:43.014168 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1455/2887] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:48:43.015365 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:43.017017 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:43.031206 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33f495-c9df-4de8-bbd0-20e76b70313a admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:43.036260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:43.036937 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:43.037213 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:43.037481 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] PATH_INFO: `/v3/projects/b72c83a33a104bca9203117302816370/users/36c5d4eaa3644fd383db11e6a31bcac5/roles/f6300a9e15d04a299f9847938352da84` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:43.039385 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72c83a33a104bca9203117302816370, user_id=36c5d4eaa3644fd383db11e6a31bcac5, role_id=f6300a9e15d04a299f9847938352da84)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:43.042044 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:43.052790 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1433/2888] 10.222.0.73 () {60 vars in 1483 bytes} [Thu Aug 18 16:48:43 2022] PUT /identity/v3/projects/b72c83a33a104bca9203117302816370/users/36c5d4eaa3644fd383db11e6a31bcac5/roles/f6300a9e15d04a299f9847938352da84 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:43.064569 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:43.064859 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:43.065137 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:43.094122 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] MFA Rules not processed for user `36c5d4eaa3644fd383db11e6a31bcac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:43.095311 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:43.107141 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:43.109489 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:43.166916 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1456/2889] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:43.179169 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:43.180599 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:43.182118 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81400581-aa9b-4560-89ae-1c5aab27bce1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:43.186816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:43.187534 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:43.187884 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:43.188260 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] PATH_INFO: `/v3/projects/218e2bb8016e4914bf273ce2b36a49f9` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:43.189384 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=218e2bb8016e4914bf273ce2b36a49f9)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:43.191281 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:43.230095 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:43.238308 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:43.239655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218e2bb8016e4914bf273ce2b36a49f9', 'request_id': 'req-3639063e-a398-4309-8e6e-5d8d95795e6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:43.241112 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7551-5527-42bb-8324-28445d61a238 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:43.247034 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218e2bb8016e4914bf273ce2b36a49f9', 'request_id': 'req-3639063e-a398-4309-8e6e-5d8d95795e6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:43.255780 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218e2bb8016e4914bf273ce2b36a49f9', 'request_id': 'req-3639063e-a398-4309-8e6e-5d8d95795e6d'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:43.268006 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] The token cache is being invalidate because project 218e2bb8016e4914bf273ce2b36a49f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:43.268354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:43.269007 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:43.270515 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1434/2890] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:43 2022] DELETE /identity/v3/projects/218e2bb8016e4914bf273ce2b36a49f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:43.294407 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:43.295078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:43.295356 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:43.295628 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:43.297575 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:43.361399 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:43.362855 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:43.373666 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1457/2891] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:48:44.876095 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:44.877623 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:44.890603 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639063e-a398-4309-8e6e-5d8d95795e6d admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:44.894268 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:44.894863 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:44.895142 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:44.895414 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:44.897117 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:44.954311 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:44.955666 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:44.965507 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1435/2892] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:45.460892 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:45.469540 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526484a6-96ce-42a3-beeb-00f3269de8f3 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:45.473204 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd9346df56842ec95720f6d4e859559', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:45.473747 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:45.474029 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:45.474305 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:45.476010 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:45.537509 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:45.538952 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e5592-984e-46ad-a70b-deab4309bcca service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:45.549088 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1458/2893] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:49.389053 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:49.390448 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:49.458480 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb27d8-d795-4b9e-ab08-72e3180c99fc service cinder] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:49.462942 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:49.463562 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:49.463911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:49.464214 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] PATH_INFO: `/v3/users/f468dd924c5242158e912e7511a467f0` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:49.465312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f468dd924c5242158e912e7511a467f0)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:49.467223 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:49.511346 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f468dd924c5242158e912e7511a467f0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:49.511985 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f468dd924c5242158e912e7511a467f0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:49.518724 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f468dd924c5242158e912e7511a467f0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:49.525422 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f468dd924c5242158e912e7511a467f0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:49.526074 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f468dd924c5242158e912e7511a467f0'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:49.536048 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:49.544949 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1436/2894] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:49 2022] DELETE /identity/v3/users/f468dd924c5242158e912e7511a467f0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:49.549428 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:49.549923 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:49.550043 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:49.570380 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] MFA Rules not processed for user `055098f463f14b67a24ad1d104cbba34`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:48:49.571558 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:49.615040 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:49.630588 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1459/2895] 10.222.0.73 () {58 vars in 958 bytes} [Thu Aug 18 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:48:49.640501 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:49.641880 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:49.717354 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f6f0e-3411-44a3-9857-a7c9c9196cc1 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:49.723918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be1be9e39a74168887220f2a4cc20d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:49.723918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:49.723918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:49.723918 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:49.731842 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:49.733302 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:49.742759 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1437/2896] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:48:50.007940 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:50.009919 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:50.024649 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fa63b-1dad-456f-87cb-add124ec1518 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:50.029955 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:50.031101 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:50.031570 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:50.031849 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] PATH_INFO: `/v3/projects/1a191709839b43e9864c199fcbaae237` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:50.033022 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a191709839b43e9864c199fcbaae237)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:50.034968 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:50.081805 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a191709839b43e9864c199fcbaae237', 'request_id': 'req-4136caff-bbb4-4a4a-85a7-c1570c5533c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.087075 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a191709839b43e9864c199fcbaae237', 'request_id': 'req-4136caff-bbb4-4a4a-85a7-c1570c5533c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.093665 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a191709839b43e9864c199fcbaae237', 'request_id': 'req-4136caff-bbb4-4a4a-85a7-c1570c5533c5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.105752 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] The token cache is being invalidate because project 1a191709839b43e9864c199fcbaae237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:50.106036 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.106667 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.108130 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1460/2897] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:50 2022] DELETE /identity/v3/projects/1a191709839b43e9864c199fcbaae237 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:50.112144 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:50.121631 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665152-68c6-433a-8bcd-7ec9185327de service neutron] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:50.177440 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:50.178096 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:50.178342 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:50.178611 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] PATH_INFO: `/v3/users/b86222d84ee14dc3bbaa483c7ba6fe9f` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:50.179704 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86222d84ee14dc3bbaa483c7ba6fe9f)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:50.181648 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:50.225570 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86222d84ee14dc3bbaa483c7ba6fe9f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.226198 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86222d84ee14dc3bbaa483c7ba6fe9f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.233655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86222d84ee14dc3bbaa483c7ba6fe9f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.240415 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86222d84ee14dc3bbaa483c7ba6fe9f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.241042 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86222d84ee14dc3bbaa483c7ba6fe9f'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.252145 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:50.260637 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1438/2898] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:50 2022] DELETE /identity/v3/users/b86222d84ee14dc3bbaa483c7ba6fe9f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:50.522839 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:50.524284 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:50.539081 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136caff-bbb4-4a4a-85a7-c1570c5533c5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:50.597389 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:50.598014 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:50.598274 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:50.598556 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] PATH_INFO: `/v3/projects/336ee6bb95354ba0a948ccb199394a30` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:50.599616 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=336ee6bb95354ba0a948ccb199394a30)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:50.601528 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:50.646113 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336ee6bb95354ba0a948ccb199394a30', 'request_id': 'req-8a6078e8-9f72-478a-8d8d-7dc467520c6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.651945 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336ee6bb95354ba0a948ccb199394a30', 'request_id': 'req-8a6078e8-9f72-478a-8d8d-7dc467520c6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.657851 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336ee6bb95354ba0a948ccb199394a30', 'request_id': 'req-8a6078e8-9f72-478a-8d8d-7dc467520c6c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.670272 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] The token cache is being invalidate because project 336ee6bb95354ba0a948ccb199394a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:50.670563 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.671174 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.672688 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1461/2899] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:50 2022] DELETE /identity/v3/projects/336ee6bb95354ba0a948ccb199394a30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:48:50.676902 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:50.678295 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:50.690816 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd79ada-8d7e-4a82-a1cd-62bfa6964d26 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:50.746569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:50.747201 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:50.747479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:50.747751 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] PATH_INFO: `/v3/users/36c5d4eaa3644fd383db11e6a31bcac5` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:50.748899 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c5d4eaa3644fd383db11e6a31bcac5)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:50.751138 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:50.802972 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c5d4eaa3644fd383db11e6a31bcac5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.803624 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c5d4eaa3644fd383db11e6a31bcac5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.810926 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c5d4eaa3644fd383db11e6a31bcac5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.817723 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c5d4eaa3644fd383db11e6a31bcac5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.818345 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c5d4eaa3644fd383db11e6a31bcac5'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:50.835312 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1439/2900] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:48:50 2022] DELETE /identity/v3/users/36c5d4eaa3644fd383db11e6a31bcac5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:48:51.100501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:48:51.101904 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:48:51.109728 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:48:51.116501 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6078e8-9f72-478a-8d8d-7dc467520c6c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:48:51.174224 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:48:51.174853 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:48:51.175131 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:48:51.175401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] PATH_INFO: `/v3/projects/b72c83a33a104bca9203117302816370` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:48:51.176543 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72c83a33a104bca9203117302816370)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:48:51.178408 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:48:51.222535 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72c83a33a104bca9203117302816370', 'request_id': 'req-1925a569-b3f9-4730-ba6d-a9d07c3556dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:51.227901 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72c83a33a104bca9203117302816370', 'request_id': 'req-1925a569-b3f9-4730-ba6d-a9d07c3556dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:51.233828 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72c83a33a104bca9203117302816370', 'request_id': 'req-1925a569-b3f9-4730-ba6d-a9d07c3556dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:51.246062 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] The token cache is being invalidate because project b72c83a33a104bca9203117302816370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:48:51.246338 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:51.246959 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:48:51.248483 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1462/2901] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:48:51 2022] DELETE /identity/v3/projects/b72c83a33a104bca9203117302816370 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:49:00.831911 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:49:01.242567 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:49:17.189479 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:49:17.191086 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:49:17.295878 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20f3a-e44e-4578-b8a4-188b1b36e147 admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:49:17.355009 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847ca98f731045cda90924197d3b800d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed88e5eaffef49d881b15eea4f3eadfb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:49:17.355622 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] REQUEST_METHOD: `GET` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:17.355906 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:17.356218 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:17.358509 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:49:17.369555 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:49:17.371129 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:49:17.380975 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1440/2902] 10.222.0.73 () {60 vars in 1365 bytes} [Thu Aug 18 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:49:24.961277 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:49:24.963978 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:49:25.047083 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a569-b3f9-4730-ba6d-a9d07c3556dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:49:25.051733 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:49:25.052391 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:25.052672 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:25.052943 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] PATH_INFO: `/v3/users/fb24aa1a986b46a795c566bbfdcd16b5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:25.054058 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb24aa1a986b46a795c566bbfdcd16b5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:49:25.056035 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:49:25.101147 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb24aa1a986b46a795c566bbfdcd16b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.101802 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb24aa1a986b46a795c566bbfdcd16b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.113870 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb24aa1a986b46a795c566bbfdcd16b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.114511 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb24aa1a986b46a795c566bbfdcd16b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.122116 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb24aa1a986b46a795c566bbfdcd16b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.135318 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1463/2903] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:49:24 2022] DELETE /identity/v3/users/fb24aa1a986b46a795c566bbfdcd16b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:49:25.316660 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:49:25.328529 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12a34-5556-47d7-b8e7-e07324b702ac service placement] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:49:25.385836 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:49:25.386464 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:25.386743 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:25.387014 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] PATH_INFO: `/v3/projects/b76b6ef465304caa91acfa19a8df12b3` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:25.388130 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76b6ef465304caa91acfa19a8df12b3)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:49:25.390569 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:49:25.406124 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=100 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:49:25.436655 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76b6ef465304caa91acfa19a8df12b3', 'request_id': 'req-5b728513-5a39-42eb-90b2-dbf6fd07d63e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.442149 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76b6ef465304caa91acfa19a8df12b3', 'request_id': 'req-5b728513-5a39-42eb-90b2-dbf6fd07d63e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.449200 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76b6ef465304caa91acfa19a8df12b3', 'request_id': 'req-5b728513-5a39-42eb-90b2-dbf6fd07d63e'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.460558 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] The token cache is being invalidate because project b76b6ef465304caa91acfa19a8df12b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:49:25.460835 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.461457 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.462919 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1441/2904] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:49:25 2022] DELETE /identity/v3/projects/b76b6ef465304caa91acfa19a8df12b3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:49:25.466918 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:49:25.469003 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:49:25.482858 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20177-129e-4054-8ea4-da6f75a4e810 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:49:25.540683 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:49:25.541309 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:25.541591 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:25.541863 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] PATH_INFO: `/v3/users/150b5f93191d45168ae07755c6ed7958` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:25.542980 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=150b5f93191d45168ae07755c6ed7958)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:49:25.544915 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:49:25.566370 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:49:25.591381 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150b5f93191d45168ae07755c6ed7958'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.592078 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150b5f93191d45168ae07755c6ed7958'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.603738 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150b5f93191d45168ae07755c6ed7958'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.604401 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150b5f93191d45168ae07755c6ed7958'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.611867 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9f3d988-f377-46f0-a82e-0a79a0a30dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150b5f93191d45168ae07755c6ed7958'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.624201 dv-cinder-853679-1-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1464/2905] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 16:49:25 2022] DELETE /identity/v3/users/150b5f93191d45168ae07755c6ed7958 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:49:25.795714 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Authenticating user token {{(pid=81631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:49:25.797168 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.fernet_utils [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:49:25.811510 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728513-5a39-42eb-90b2-dbf6fd07d63e admin admin] Validating token access rules against request {{(pid=81631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:49:25.867932 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055098f463f14b67a24ad1d104cbba34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f85ef77f8be4f4d9ae6c447129ea73f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:49:25.868587 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:25.868864 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:25.869180 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] PATH_INFO: `/v3/projects/883b009154f0469c8ff6a850d630d3d6` {{(pid=81631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:25.870287 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883b009154f0469c8ff6a850d630d3d6)` {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:49:25.872292 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] RBAC: Authorization granted {{(pid=81631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:49:25.917752 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883b009154f0469c8ff6a850d630d3d6', 'request_id': 'req-113d84d9-c05b-40fc-b034-3e7c00c14396'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.923468 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883b009154f0469c8ff6a850d630d3d6', 'request_id': 'req-113d84d9-c05b-40fc-b034-3e7c00c14396'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.930617 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883b009154f0469c8ff6a850d630d3d6', 'request_id': 'req-113d84d9-c05b-40fc-b034-3e7c00c14396'} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.941934 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] The token cache is being invalidate because project 883b009154f0469c8ff6a850d630d3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 16:49:25.942222 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.942843 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG keystone.notifications [None req-113d84d9-c05b-40fc-b034-3e7c00c14396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 16:49:25.944327 dv-cinder-853679-1-smb devstack@keystone.service[81631]: [pid: 81631|app: 0|req: 1442/2906] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 16:49:25 2022] DELETE /identity/v3/projects/883b009154f0469c8ff6a850d630d3d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:49:35.620373 dv-cinder-853679-1-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:49:35.938983 dv-cinder-853679-1-smb devstack@keystone.service[81631]: DEBUG dbcounter [-] [81631] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}